Oct 26 06:21:55 user nova-compute[74295]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74295) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 06:21:55 user nova-compute[74295]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74295) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 06:21:55 user nova-compute[74295]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74295) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 06:21:55 user nova-compute[74295]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 26 06:21:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:21:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:21:56 user nova-compute[74295]: INFO nova.virt.driver [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 26 06:21:56 user nova-compute[74295]: INFO nova.compute.provider_config [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] Acquiring lock "singleton_lock" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] Acquired lock "singleton_lock" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] Releasing lock "singleton_lock" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] Full set of CONF: {{(pid=74295) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ******************************************************************************** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] Configuration options gathered from: {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ================================================================================ {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] allow_resize_to_same_host      = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] arq_binding_timeout            = 300 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] backdoor_port                  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] backdoor_socket                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] block_device_allocate_retries  = 300 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] block_device_allocate_retries_interval = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cert                           = self.pem {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute_monitors               = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] config_dir                     = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] config_drive_format            = iso9660 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] config_source                  = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] console_host                   = user {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] control_exchange               = nova {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cpu_allocation_ratio           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] daemon                         = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] debug                          = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] default_access_ip_network_name = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] default_availability_zone      = nova {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] default_ephemeral_format       = ext4 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] default_green_pool_size        = 1000 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] default_schedule_zone          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] disk_allocation_ratio          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] enable_new_services            = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] enabled_apis                   = ['osapi_compute'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] enabled_ssl_apis               = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] flat_injected                  = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] force_config_drive             = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] force_raw_images               = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] graceful_shutdown_timeout      = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] heal_instance_info_cache_interval = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] host                           = user {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] instance_build_timeout         = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] instance_delete_interval       = 300 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] instance_format                = [instance: %(uuid)s]  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] instance_name_template         = instance-%08x {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] instance_usage_audit           = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] instance_usage_audit_period    = month {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] internal_service_availability_zone = internal {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] key                            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] live_migration_retry_count     = 30 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] log_config_append              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] log_dir                        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] log_file                       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] log_options                    = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] log_rotate_interval            = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] log_rotate_interval_type       = days {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] log_rotation_type              = none {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] long_rpc_timeout               = 1800 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] max_concurrent_builds          = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] max_concurrent_live_migrations = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] max_concurrent_snapshots       = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] max_local_block_devices        = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] max_logfile_count              = 30 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] max_logfile_size_mb            = 200 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] maximum_instance_delete_attempts = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] metadata_listen                = 0.0.0.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] metadata_listen_port           = 8775 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] metadata_workers               = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] migrate_max_retries            = -1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] mkisofs_cmd                    = genisoimage {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] my_ip                          = 10.0.0.210 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] network_allocate_retries       = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] osapi_compute_listen_port      = 8774 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] osapi_compute_unique_server_name_scope =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] osapi_compute_workers          = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] password_length                = 12 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] periodic_enable                = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] periodic_fuzzy_delay           = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] pointer_model                  = ps2mouse {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] preallocate_images             = none {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] publish_errors                 = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] pybasedir                      = /opt/stack/nova {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ram_allocation_ratio           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] rate_limit_burst               = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] rate_limit_except_level        = CRITICAL {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] rate_limit_interval            = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] reboot_timeout                 = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] reclaim_instance_interval      = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] record                         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] reimage_timeout_per_gb         = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] report_interval                = 120 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] rescue_timeout                 = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] reserved_host_cpus             = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] reserved_host_disk_mb          = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] reserved_host_memory_mb        = 512 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] reserved_huge_pages            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] resize_confirm_window          = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] resize_fs_using_block_device   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] resume_guests_state_on_host_boot = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] rpc_response_timeout           = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] run_external_periodic_tasks    = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] running_deleted_instance_action = reap {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] running_deleted_instance_poll_interval = 1800 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] running_deleted_instance_timeout = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler_instance_sync_interval = 120 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_down_time              = 720 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] servicegroup_driver            = db {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] shelved_offload_time           = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] shelved_poll_interval          = 3600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] shutdown_timeout               = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] source_is_ipv6                 = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ssl_only                       = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] state_path                     = /opt/stack/data/nova {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] sync_power_state_interval      = 600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] sync_power_state_pool_size     = 1000 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] syslog_log_facility            = LOG_USER {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] tempdir                        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] timeout_nbd                    = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] transport_url                  = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] update_resources_interval      = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] use_cow_images                 = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] use_eventlog                   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] use_journal                    = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] use_json                       = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] use_rootwrap_daemon            = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] use_stderr                     = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] use_syslog                     = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vcpu_pin_set                   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plugging_is_fatal          = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plugging_timeout           = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] virt_mkfs                      = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] volume_usage_poll_interval     = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] watch_log_file                 = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] web                            = /usr/share/spice-html5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_concurrency.disable_process_locking = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.auth_strategy              = keystone {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.compute_link_prefix        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.dhcp_domain                = novalocal {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.enable_instance_password   = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.glance_link_prefix         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.instance_list_per_project_cells = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.list_records_by_skipping_down_cells = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.local_metadata_per_cell    = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.max_limit                  = 1000 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.metadata_cache_expiration  = 15 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.neutron_default_tenant_id  = default {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.use_forwarded_for          = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.use_neutron_default_nets   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.vendordata_dynamic_targets = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.vendordata_jsonfile_path   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.backend                  = dogpile.cache.memcached {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.backend_argument         = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.config_prefix            = cache.oslo {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.dead_timeout             = 60.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.debug_cache_backend      = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.enable_retry_client      = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.enable_socket_keepalive  = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.enabled                  = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.expiration_time          = 600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.hashclient_retry_attempts = 2 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_dead_retry      = 300 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_password        =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_pool_maxsize    = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_sasl_enabled    = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.memcache_username        =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.proxies                  = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.retry_attempts           = 2 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.retry_delay              = 0.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.socket_keepalive_count   = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.socket_keepalive_idle    = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.socket_keepalive_interval = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.tls_allowed_ciphers      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.tls_cafile               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.tls_certfile             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.tls_enabled              = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cache.tls_keyfile              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.auth_section            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.auth_type               = password {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.cafile                  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.certfile                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.collect_timing          = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.cross_az_attach         = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.debug                   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.endpoint_template       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.http_retries            = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.insecure                = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.keyfile                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.os_region_name          = RegionOne {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.split_loggers           = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cinder.timeout                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.cpu_dedicated_set      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.cpu_shared_set         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.image_type_exclude_list = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.max_concurrent_disk_ops = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.max_disk_devices_to_attach = -1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.resource_provider_association_refresh = 300 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.shutdown_retry_interval = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] conductor.workers              = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] console.allowed_origins        = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] console.ssl_ciphers            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] console.ssl_minimum_version    = default {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] consoleauth.token_ttl          = 600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.cafile                  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.certfile                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.collect_timing          = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.connect_retries         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.connect_retry_delay     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.endpoint_override       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.insecure                = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.keyfile                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.max_version             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.min_version             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.region_name             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.service_name            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.service_type            = accelerator {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.split_loggers           = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.status_code_retries     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.status_code_retry_delay = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.timeout                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] cyborg.version                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.backend               = sqlalchemy {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.connection            = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.connection_debug      = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.connection_parameters =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.connection_recycle_time = 3600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.connection_trace      = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.db_inc_retry_interval = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.db_max_retries        = 20 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.db_max_retry_interval = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.db_retry_interval     = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.max_overflow          = 50 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.max_pool_size         = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.max_retries           = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.mysql_wsrep_sync_wait = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.pool_timeout          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.retry_interval        = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.slave_connection      = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] database.sqlite_synchronous    = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.backend           = sqlalchemy {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.connection        = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.connection_debug  = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.connection_parameters =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.connection_recycle_time = 3600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.connection_trace  = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.db_inc_retry_interval = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.db_max_retries    = 20 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.db_max_retry_interval = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.db_retry_interval = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.max_overflow      = 50 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.max_pool_size     = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.max_retries       = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.pool_timeout      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.retry_interval    = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.slave_connection  = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] api_database.sqlite_synchronous = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] devices.enabled_mdev_types     = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ephemeral_storage_encryption.enabled = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.api_servers             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.cafile                  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.certfile                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.collect_timing          = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.connect_retries         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.connect_retry_delay     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.debug                   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.default_trusted_certificate_ids = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.enable_certificate_validation = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.enable_rbd_download     = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.endpoint_override       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.insecure                = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.keyfile                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.max_version             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.min_version             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.num_retries             = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.rbd_ceph_conf           =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.rbd_connect_timeout     = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.rbd_pool                =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.rbd_user                =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.region_name             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.service_name            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.service_type            = image {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.split_loggers           = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.status_code_retries     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.status_code_retry_delay = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.timeout                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.verify_glance_signatures = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] glance.version                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] guestfs.debug                  = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.config_drive_cdrom      = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.config_drive_inject_password = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.enable_instance_metrics_collection = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.enable_remotefx         = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.instances_path_share    =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.iscsi_initiator_list    = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.limit_cpu_features      = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.power_state_check_timeframe = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.use_multipath_io        = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.volume_attach_retry_count = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.vswitch_name            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] mks.enabled                    = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] image_cache.manager_interval   = 2400 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] image_cache.precache_concurrency = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] image_cache.remove_unused_base_images = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] image_cache.subdirectory_name  = _base {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.api_max_retries         = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.api_retry_interval      = 2 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.auth_section            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.auth_type               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.cafile                  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.certfile                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.collect_timing          = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.conductor_group         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.connect_retries         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.connect_retry_delay     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.endpoint_override       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.insecure                = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.keyfile                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.max_version             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.min_version             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.peer_list               = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.region_name             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.serial_console_state_timeout = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.service_name            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.service_type            = baremetal {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.split_loggers           = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.status_code_retries     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.status_code_retry_delay = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.timeout                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ironic.version                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] key_manager.fixed_key          = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.barbican_api_version  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.barbican_endpoint     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.barbican_endpoint_type = public {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.barbican_region_name  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.cafile                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.certfile              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.collect_timing        = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.insecure              = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.keyfile               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.number_of_retries     = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.retry_delay           = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.send_service_user_token = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.split_loggers         = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.timeout               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.verify_ssl            = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican.verify_ssl_path       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican_service_user.auth_section = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican_service_user.auth_type = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican_service_user.cafile   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican_service_user.certfile = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican_service_user.collect_timing = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican_service_user.insecure = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican_service_user.keyfile  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican_service_user.split_loggers = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] barbican_service_user.timeout  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.approle_role_id          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.approle_secret_id        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.cafile                   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.certfile                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.collect_timing           = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.insecure                 = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.keyfile                  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.kv_mountpoint            = secret {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.kv_path                  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.kv_version               = 2 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.namespace                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.root_token_id            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.split_loggers            = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.ssl_ca_crt_file          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.timeout                  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.use_ssl                  = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.auth_section          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.auth_type             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.cafile                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.certfile              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.collect_timing        = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.connect_retries       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.connect_retry_delay   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.endpoint_override     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.insecure              = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.keyfile               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.max_version           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.min_version           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.region_name           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.service_name          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.service_type          = identity {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.split_loggers         = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.status_code_retries   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.status_code_retry_delay = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.timeout               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] keystone.version               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.connection_uri         =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.cpu_mode               = custom {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: WARNING oslo_config.cfg [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.cpu_power_governor_high = performance {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.cpu_power_governor_low = powersave {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.cpu_power_management   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.device_detach_attempts = 8 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.device_detach_timeout  = 20 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.disk_cachemodes        = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.disk_prefix            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.enabled_perf_events    = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.file_backed_memory     = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.gid_maps               = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.hw_disk_discard        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.hw_machine_type        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.images_rbd_glance_store_name =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.images_rbd_pool        = rbd {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.images_type            = default {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.images_volume_group    = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.inject_key             = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.inject_partition       = -2 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.inject_password        = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.iscsi_iface            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.iser_use_multipath     = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_bandwidth = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_downtime = 500 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_inbound_addr = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_permit_post_copy = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_scheme  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_timeout_action = abort {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_tunnelled = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: WARNING oslo_config.cfg [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 26 06:21:56 user nova-compute[74295]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 26 06:21:56 user nova-compute[74295]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 26 06:21:56 user nova-compute[74295]: and ``live_migration_inbound_addr`` respectively.
Oct 26 06:21:56 user nova-compute[74295]: ).  Its value may be silently ignored in the future.
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.live_migration_with_native_tls = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.max_queues             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.nfs_mount_options      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.num_memory_encrypted_guests = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.num_pcie_ports         = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.pmem_namespaces        = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.quobyte_client_cfg     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rbd_secret_uuid        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rbd_user               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.remote_filesystem_transport = ssh {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rescue_image_id        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rescue_kernel_id       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rescue_ramdisk_id      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.rx_queue_size          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.smbfs_mount_options    =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.snapshot_compression   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.snapshot_image_format  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.sparse_logical_volumes = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.swtpm_enabled          = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.swtpm_group            = tss {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.swtpm_user             = tss {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.sysinfo_serial         = unique {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.tb_cache_size          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.tx_queue_size          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.uid_maps               = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.use_virtio_for_bridges = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.virt_type              = kvm {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.volume_clear           = zero {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.volume_clear_size      = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.volume_use_multipath   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.vzstorage_cache_path   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.vzstorage_mount_user   = stack {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.auth_section           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.auth_type              = password {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.cafile                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.certfile               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.collect_timing         = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.connect_retries        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.connect_retry_delay    = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.default_floating_pool  = public {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.endpoint_override      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.extension_sync_interval = 600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.http_retries           = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.insecure               = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.keyfile                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.max_version            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.min_version            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.ovs_bridge             = br-int {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.physnets               = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.region_name            = RegionOne {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.service_metadata_proxy = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.service_name           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.service_type           = network {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.split_loggers          = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.status_code_retries    = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.status_code_retry_delay = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.timeout                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] neutron.version                = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] notifications.bdms_in_notifications = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] notifications.default_level    = INFO {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] notifications.notification_format = unversioned {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] notifications.notify_on_state_change = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] pci.alias                      = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] pci.device_spec                = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] pci.report_in_placement        = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.auth_section         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.auth_type            = password {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.cafile               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.certfile             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.collect_timing       = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.connect_retries      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.connect_retry_delay  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.default_domain_id    = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.default_domain_name  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.domain_id            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.domain_name          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.endpoint_override    = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.insecure             = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.keyfile              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.max_version          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.min_version          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.password             = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.project_domain_id    = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.project_domain_name  = Default {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.project_id           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.project_name         = service {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.region_name          = RegionOne {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.service_name         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.service_type         = placement {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.split_loggers        = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.status_code_retries  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.status_code_retry_delay = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.system_scope         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.timeout              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.trust_id             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.user_domain_id       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.user_domain_name     = Default {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.user_id              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.username             = placement {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] placement.version              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.cores                    = 20 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.count_usage_from_placement = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.injected_file_content_bytes = 10240 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.injected_file_path_length = 255 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.injected_files           = 5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.instances                = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.key_pairs                = 100 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.metadata_items           = 128 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.ram                      = 51200 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.recheck_quota            = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.server_group_members     = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] quota.server_groups            = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] rdp.enabled                    = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.image_metadata_prefilter = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.max_attempts         = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.max_placement_results = 1000 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.query_placement_for_image_type_support = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] scheduler.workers              = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.host_subset_size = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.isolated_hosts = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.isolated_images = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.pci_in_placement = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.track_instance_changes = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] metrics.required               = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] metrics.weight_multiplier      = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] metrics.weight_setting         = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] serial_console.enabled         = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] serial_console.port_range      = 10000:20000 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] serial_console.serialproxy_port = 6083 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.auth_section      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.auth_type         = password {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.cafile            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.certfile          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.collect_timing    = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.insecure          = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.keyfile           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.send_service_user_token = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.split_loggers     = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] service_user.timeout           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.agent_enabled            = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.enabled                  = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.html5proxy_port          = 6082 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.image_compression        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.jpeg_compression         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.playback_compression     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.server_listen            = 127.0.0.1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.streaming_mode           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] spice.zlib_compression         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] upgrade_levels.baseapi         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] upgrade_levels.cert            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] upgrade_levels.compute         = auto {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] upgrade_levels.conductor       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] upgrade_levels.scheduler       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vendordata_dynamic_auth.auth_section = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vendordata_dynamic_auth.auth_type = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vendordata_dynamic_auth.cafile = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vendordata_dynamic_auth.certfile = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vendordata_dynamic_auth.insecure = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vendordata_dynamic_auth.keyfile = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vendordata_dynamic_auth.timeout = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.api_retry_count         = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.ca_file                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.cache_prefix            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.cluster_name            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.connection_pool_size    = 10 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.console_delay_seconds   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.datastore_regex         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.host_ip                 = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.host_password           = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.host_port               = 443 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.host_username           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.insecure                = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.integration_bridge      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.maximum_objects         = 100 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.pbm_default_policy      = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.pbm_enabled             = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.pbm_wsdl_location       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.serial_port_proxy_uri   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.serial_port_service_uri = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.task_poll_interval      = 0.5 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.use_linked_clone        = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.vnc_keymap              = en-us {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.vnc_port                = 5900 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vmware.vnc_port_total          = 10000 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.auth_schemes               = ['none'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.enabled                    = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.novncproxy_port            = 6080 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.server_listen              = 0.0.0.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.vencrypt_ca_certs          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.vencrypt_client_cert       = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vnc.vencrypt_client_key        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.disable_rootwrap   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.enable_numa_live_migration = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.libvirt_disable_apic = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.client_socket_timeout     = 900 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.default_pool_size         = 1000 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.keep_alive                = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.max_header_line           = 16384 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.ssl_ca_file               = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.ssl_cert_file             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.ssl_key_file              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.tcp_keepidle              = 600 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] zvm.ca_file                    = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] zvm.cloud_connector_url        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] zvm.reachable_timeout          = 300 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.enforce_new_defaults = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.enforce_scope      = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.policy_default_rule = default {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.policy_file        = policy.yaml {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.connection_string     = messaging:// {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.enabled               = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.es_doc_type           = notification {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.es_scroll_size        = 10000 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.es_scroll_time        = 2m {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.filter_error_trace    = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.hmac_keys             = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.sentinel_service_name = mymaster {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.socket_timeout        = 0.1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.trace_requests        = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler.trace_sqlalchemy      = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler_jaeger.process_tags   = {} {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler_jaeger.service_name_prefix = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] profiler_otlp.service_name_prefix = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] remote_debug.host              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] remote_debug.port              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.ssl      = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_notifications.retry = -1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_messaging_notifications.transport_url = **** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.auth_section        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.auth_type           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.cafile              = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.certfile            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.collect_timing      = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.connect_retries     = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.connect_retry_delay = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.endpoint_id         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.endpoint_override   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.insecure            = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.keyfile             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.max_version         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.min_version         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.region_name         = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.service_name        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.service_type        = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.split_loggers       = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.status_code_retries = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.status_code_retry_delay = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.timeout             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.valid_interfaces    = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_limit.version             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_reports.file_event_handler = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] oslo_reports.log_dir           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_ovs_privileged.group  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] vif_plug_ovs_privileged.user   = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_linux_bridge.flat_interface = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_ovs.isolate_vif         = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_vif_ovs.per_port_bridge     = False {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] os_brick.lock_path             = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] privsep_osbrick.capabilities   = [21] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] privsep_osbrick.group          = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] privsep_osbrick.helper_command = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] privsep_osbrick.user           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] nova_sys_admin.group           = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] nova_sys_admin.helper_command  = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] nova_sys_admin.user            = None {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG oslo_service.service [None req-280620b1-d2e6-4779-b94d-7a1ef685662f None None] ******************************************************************************** {{(pid=74295) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 26 06:21:56 user nova-compute[74295]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 26 06:21:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Connecting to libvirt: qemu:///system {{(pid=74295) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f35b55ce500> {{(pid=74295) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 26 06:21:56 user nova-compute[74295]: libvirt:  error : internal error: could not initialize domain event timer
Oct 26 06:21:56 user nova-compute[74295]: WARNING nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 26 06:21:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f35b55ce500> {{(pid=74295) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Starting native event thread {{(pid=74295) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Starting green dispatch thread {{(pid=74295) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 26 06:21:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Starting connection event dispatch thread {{(pid=74295) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 26 06:21:56 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Connection event '1' reason 'None'
Oct 26 06:21:56 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 06:21:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.mount [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Initialising _HostMountState generation 0 {{(pid=74295) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 26 06:22:03 user nova-compute[74295]: INFO nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt host capabilities <capabilities>
Oct 26 06:22:03 user nova-compute[74295]:   <host>
Oct 26 06:22:03 user nova-compute[74295]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 26 06:22:03 user nova-compute[74295]:     <cpu>
Oct 26 06:22:03 user nova-compute[74295]:       <arch>x86_64</arch>
Oct 26 06:22:03 user nova-compute[74295]:       <model>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <vendor>Intel</vendor>
Oct 26 06:22:03 user nova-compute[74295]:       <microcode version='1070'/>
Oct 26 06:22:03 user nova-compute[74295]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 26 06:22:03 user nova-compute[74295]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='ss'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='vmx'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='pcid'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='osxsave'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='hypervisor'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='arat'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='tsc_adjust'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='md-clear'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='arch-capabilities'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='invtsc'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='rsba'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature name='skip-l1dfl-vmentry'/>
Oct 26 06:22:03 user nova-compute[74295]:       <pages unit='KiB' size='4'/>
Oct 26 06:22:03 user nova-compute[74295]:       <pages unit='KiB' size='2048'/>
Oct 26 06:22:03 user nova-compute[74295]:     </cpu>
Oct 26 06:22:03 user nova-compute[74295]:     <power_management>
Oct 26 06:22:03 user nova-compute[74295]:       <suspend_mem/>
Oct 26 06:22:03 user nova-compute[74295]:       <suspend_disk/>
Oct 26 06:22:03 user nova-compute[74295]:       <suspend_hybrid/>
Oct 26 06:22:03 user nova-compute[74295]:     </power_management>
Oct 26 06:22:03 user nova-compute[74295]:     <iommu support='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     <migration_features>
Oct 26 06:22:03 user nova-compute[74295]:       <live/>
Oct 26 06:22:03 user nova-compute[74295]:       <uri_transports>
Oct 26 06:22:03 user nova-compute[74295]:         <uri_transport>tcp</uri_transport>
Oct 26 06:22:03 user nova-compute[74295]:         <uri_transport>rdma</uri_transport>
Oct 26 06:22:03 user nova-compute[74295]:       </uri_transports>
Oct 26 06:22:03 user nova-compute[74295]:     </migration_features>
Oct 26 06:22:03 user nova-compute[74295]:     <topology>
Oct 26 06:22:03 user nova-compute[74295]:       <cells num='2'>
Oct 26 06:22:03 user nova-compute[74295]:         <cell id='0'>
Oct 26 06:22:03 user nova-compute[74295]:           <memory unit='KiB'>8189224</memory>
Oct 26 06:22:03 user nova-compute[74295]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 26 06:22:03 user nova-compute[74295]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 06:22:03 user nova-compute[74295]:           <distances>
Oct 26 06:22:03 user nova-compute[74295]:             <sibling id='0' value='10'/>
Oct 26 06:22:03 user nova-compute[74295]:             <sibling id='1' value='20'/>
Oct 26 06:22:03 user nova-compute[74295]:           </distances>
Oct 26 06:22:03 user nova-compute[74295]:           <cpus num='6'>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 26 06:22:03 user nova-compute[74295]:           </cpus>
Oct 26 06:22:03 user nova-compute[74295]:         </cell>
Oct 26 06:22:03 user nova-compute[74295]:         <cell id='1'>
Oct 26 06:22:03 user nova-compute[74295]:           <memory unit='KiB'>8206460</memory>
Oct 26 06:22:03 user nova-compute[74295]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 26 06:22:03 user nova-compute[74295]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 06:22:03 user nova-compute[74295]:           <distances>
Oct 26 06:22:03 user nova-compute[74295]:             <sibling id='0' value='20'/>
Oct 26 06:22:03 user nova-compute[74295]:             <sibling id='1' value='10'/>
Oct 26 06:22:03 user nova-compute[74295]:           </distances>
Oct 26 06:22:03 user nova-compute[74295]:           <cpus num='6'>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 26 06:22:03 user nova-compute[74295]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 26 06:22:03 user nova-compute[74295]:           </cpus>
Oct 26 06:22:03 user nova-compute[74295]:         </cell>
Oct 26 06:22:03 user nova-compute[74295]:       </cells>
Oct 26 06:22:03 user nova-compute[74295]:     </topology>
Oct 26 06:22:03 user nova-compute[74295]:     <cache>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 26 06:22:03 user nova-compute[74295]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 26 06:22:03 user nova-compute[74295]:     </cache>
Oct 26 06:22:03 user nova-compute[74295]:     <secmodel>
Oct 26 06:22:03 user nova-compute[74295]:       <model>apparmor</model>
Oct 26 06:22:03 user nova-compute[74295]:       <doi>0</doi>
Oct 26 06:22:03 user nova-compute[74295]:     </secmodel>
Oct 26 06:22:03 user nova-compute[74295]:     <secmodel>
Oct 26 06:22:03 user nova-compute[74295]:       <model>dac</model>
Oct 26 06:22:03 user nova-compute[74295]:       <doi>0</doi>
Oct 26 06:22:03 user nova-compute[74295]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 26 06:22:03 user nova-compute[74295]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 26 06:22:03 user nova-compute[74295]:     </secmodel>
Oct 26 06:22:03 user nova-compute[74295]:   </host>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='alpha'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>clipper</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='armv6l'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>spitz</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>nuri</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>kzm</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sx1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>z2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>tosa</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>n810</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>n800</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>terrier</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>midway</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>microbit</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>verdex</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>highbank</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>akita</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>connex</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>collie</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='armv7l'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>spitz</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>nuri</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>kzm</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sx1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>z2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>tosa</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>n810</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>n800</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>terrier</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>midway</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>microbit</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>verdex</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>highbank</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>akita</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>connex</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>collie</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='aarch64'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>spitz</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>nuri</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>kzm</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sx1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>z2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>tosa</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>n810</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>n800</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>terrier</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>midway</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>microbit</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>verdex</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>raspi3b</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>highbank</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>akita</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>connex</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>collie</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <acpi default='on' toggle='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='cris'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='i686'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>isapc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>microvm</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='kvm'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <pae/>
Oct 26 06:22:03 user nova-compute[74295]:       <nonpae/>
Oct 26 06:22:03 user nova-compute[74295]:       <acpi default='on' toggle='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:       <apic default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='m68k'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>an5206</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>q800</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>next-cube</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='microblaze'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='microblazeel'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='mips'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='16'>malta</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='mipsel'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='16'>malta</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='mips64'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='16'>malta</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>pica61</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>magnum</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='mips64el'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='16'>malta</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>pica61</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>magnum</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='16'>boston</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='ppc'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mac99</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>40p</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>taihu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='ppc64'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>taihu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>40p</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mac99</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='ppc64le'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>taihu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>40p</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>mac99</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='riscv32'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='8'>spike</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>opentitan</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='8'>virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='riscv64'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='8'>spike</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>shakti_c</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='8'>virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='s390x'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='sh4'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>shix</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>r2d</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='sh4eb'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>shix</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>r2d</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='sparc'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>SS-5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>SS-20</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>LX</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>SS-4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>SS-10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>Voyager</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='sparc64'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sun4u</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>niagara</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>sun4v</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='x86_64'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>64</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='1'>isapc</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>microvm</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='kvm'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <acpi default='on' toggle='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:       <apic default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='xtensa'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>sim</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>kc705</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>ml605</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>lx200</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>lx60</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]:   <guest>
Oct 26 06:22:03 user nova-compute[74295]:     <os_type>hvm</os_type>
Oct 26 06:22:03 user nova-compute[74295]:     <arch name='xtensaeb'>
Oct 26 06:22:03 user nova-compute[74295]:       <wordsize>32</wordsize>
Oct 26 06:22:03 user nova-compute[74295]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='4'>sim</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>kc705</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>ml605</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>virt</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>lx200</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>lx60</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 06:22:03 user nova-compute[74295]:       <domain type='qemu'/>
Oct 26 06:22:03 user nova-compute[74295]:     </arch>
Oct 26 06:22:03 user nova-compute[74295]:     <features>
Oct 26 06:22:03 user nova-compute[74295]:       <cpuselection/>
Oct 26 06:22:03 user nova-compute[74295]:       <deviceboot/>
Oct 26 06:22:03 user nova-compute[74295]:       <disksnapshot default='on' toggle='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     </features>
Oct 26 06:22:03 user nova-compute[74295]:   </guest>
Oct 26 06:22:03 user nova-compute[74295]: </capabilities>
Oct 26 06:22:03 user nova-compute[74295]: 
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 26 06:22:03 user nova-compute[74295]: <domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 06:22:03 user nova-compute[74295]:   <domain>kvm</domain>
Oct 26 06:22:03 user nova-compute[74295]:   <machine>pc-q35-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:   <arch>i686</arch>
Oct 26 06:22:03 user nova-compute[74295]:   <vcpu max='288'/>
Oct 26 06:22:03 user nova-compute[74295]:   <iothreads supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:   <os supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='firmware'/>
Oct 26 06:22:03 user nova-compute[74295]:     <loader supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>rom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pflash</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='readonly'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='secure'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </loader>
Oct 26 06:22:03 user nova-compute[74295]:   </os>
Oct 26 06:22:03 user nova-compute[74295]:   <cpu>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-passthrough' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='hostPassthroughMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='maximum' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='maximumMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-model' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <vendor>Intel</vendor>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ss'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='vmx'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pcid'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='hypervisor'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arat'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='umip'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='md-clear'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibpb'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibrs'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='erms'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='lm'/>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='custom' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>qemu64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>qemu32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>phenom</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>n270</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>kvm64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>coreduo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>core2duo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>athlon</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Westmere</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Snowridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Penryn</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G5</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G4</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G1</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Nehalem</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Rome</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Milan</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Dhyana</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cooperlake</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Conroe</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>486</model>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:   </cpu>
Oct 26 06:22:03 user nova-compute[74295]:   <memoryBacking supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='sourceType'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>file</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>anonymous</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>memfd</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:   </memoryBacking>
Oct 26 06:22:03 user nova-compute[74295]:   <devices>
Oct 26 06:22:03 user nova-compute[74295]:     <disk supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='diskDevice'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>disk</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cdrom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>floppy</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>lun</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='bus'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>fdc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sata</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </disk>
Oct 26 06:22:03 user nova-compute[74295]:     <graphics supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sdl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vnc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>spice</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egl-headless</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </graphics>
Oct 26 06:22:03 user nova-compute[74295]:     <video supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='modelType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cirrus</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vmvga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>qxl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>none</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>bochs</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ramfb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </video>
Oct 26 06:22:03 user nova-compute[74295]:     <hostdev supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='mode'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>subsystem</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='startupPolicy'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>default</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>mandatory</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>requisite</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>optional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='subsysType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pci</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='capsType'/>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='pciBackend'/>
Oct 26 06:22:03 user nova-compute[74295]:     </hostdev>
Oct 26 06:22:03 user nova-compute[74295]:     <rng supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>random</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egd</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>builtin</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </rng>
Oct 26 06:22:03 user nova-compute[74295]:     <filesystem supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='driverType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>path</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>handle</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtiofs</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </filesystem>
Oct 26 06:22:03 user nova-compute[74295]:     <tpm supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-tis</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-crb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>passthrough</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>emulator</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </tpm>
Oct 26 06:22:03 user nova-compute[74295]:   </devices>
Oct 26 06:22:03 user nova-compute[74295]:   <features>
Oct 26 06:22:03 user nova-compute[74295]:     <gic supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     <vmcoreinfo supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <genid supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backingStoreInput supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backup supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <sev supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:   </features>
Oct 26 06:22:03 user nova-compute[74295]: </domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:  {{(pid=74295) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 26 06:22:03 user nova-compute[74295]: <domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 06:22:03 user nova-compute[74295]:   <domain>kvm</domain>
Oct 26 06:22:03 user nova-compute[74295]:   <machine>pc-i440fx-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:   <arch>i686</arch>
Oct 26 06:22:03 user nova-compute[74295]:   <vcpu max='255'/>
Oct 26 06:22:03 user nova-compute[74295]:   <iothreads supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:   <os supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='firmware'/>
Oct 26 06:22:03 user nova-compute[74295]:     <loader supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>rom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pflash</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='readonly'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='secure'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </loader>
Oct 26 06:22:03 user nova-compute[74295]:   </os>
Oct 26 06:22:03 user nova-compute[74295]:   <cpu>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-passthrough' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='hostPassthroughMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='maximum' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='maximumMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-model' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <vendor>Intel</vendor>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ss'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='vmx'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pcid'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='hypervisor'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arat'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='umip'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='md-clear'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibpb'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibrs'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='erms'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='lm'/>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='custom' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>qemu64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>qemu32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>phenom</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>n270</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>kvm64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>coreduo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>core2duo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>athlon</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Westmere</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Snowridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Penryn</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G5</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G4</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G1</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Nehalem</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Rome</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Milan</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Dhyana</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cooperlake</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Conroe</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>486</model>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:   </cpu>
Oct 26 06:22:03 user nova-compute[74295]:   <memoryBacking supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='sourceType'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>file</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>anonymous</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>memfd</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:   </memoryBacking>
Oct 26 06:22:03 user nova-compute[74295]:   <devices>
Oct 26 06:22:03 user nova-compute[74295]:     <disk supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='diskDevice'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>disk</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cdrom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>floppy</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>lun</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='bus'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ide</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>fdc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sata</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </disk>
Oct 26 06:22:03 user nova-compute[74295]:     <graphics supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sdl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vnc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>spice</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egl-headless</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </graphics>
Oct 26 06:22:03 user nova-compute[74295]:     <video supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='modelType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cirrus</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vmvga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>qxl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>none</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>bochs</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ramfb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </video>
Oct 26 06:22:03 user nova-compute[74295]:     <hostdev supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='mode'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>subsystem</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='startupPolicy'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>default</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>mandatory</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>requisite</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>optional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='subsysType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pci</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='capsType'/>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='pciBackend'/>
Oct 26 06:22:03 user nova-compute[74295]:     </hostdev>
Oct 26 06:22:03 user nova-compute[74295]:     <rng supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>random</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egd</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>builtin</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </rng>
Oct 26 06:22:03 user nova-compute[74295]:     <filesystem supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='driverType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>path</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>handle</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtiofs</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </filesystem>
Oct 26 06:22:03 user nova-compute[74295]:     <tpm supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-tis</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-crb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>passthrough</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>emulator</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </tpm>
Oct 26 06:22:03 user nova-compute[74295]:   </devices>
Oct 26 06:22:03 user nova-compute[74295]:   <features>
Oct 26 06:22:03 user nova-compute[74295]:     <gic supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     <vmcoreinfo supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <genid supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backingStoreInput supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backup supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <sev supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:   </features>
Oct 26 06:22:03 user nova-compute[74295]: </domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:  {{(pid=74295) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 26 06:22:03 user nova-compute[74295]: <domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 06:22:03 user nova-compute[74295]:   <domain>kvm</domain>
Oct 26 06:22:03 user nova-compute[74295]:   <machine>pc-i440fx-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:   <arch>i686</arch>
Oct 26 06:22:03 user nova-compute[74295]:   <vcpu max='255'/>
Oct 26 06:22:03 user nova-compute[74295]:   <iothreads supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:   <os supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='firmware'/>
Oct 26 06:22:03 user nova-compute[74295]:     <loader supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>rom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pflash</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='readonly'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='secure'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </loader>
Oct 26 06:22:03 user nova-compute[74295]:   </os>
Oct 26 06:22:03 user nova-compute[74295]:   <cpu>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-passthrough' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='hostPassthroughMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='maximum' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='maximumMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-model' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <vendor>Intel</vendor>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ss'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='vmx'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pcid'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='hypervisor'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arat'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='umip'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='md-clear'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibpb'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibrs'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='erms'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='lm'/>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='custom' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>qemu64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>qemu32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>phenom</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>n270</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>kvm64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>coreduo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>core2duo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>athlon</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Westmere</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Snowridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Penryn</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G5</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G4</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G1</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Nehalem</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Rome</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Milan</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Dhyana</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cooperlake</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Conroe</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>486</model>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:   </cpu>
Oct 26 06:22:03 user nova-compute[74295]:   <memoryBacking supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='sourceType'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>file</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>anonymous</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>memfd</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:   </memoryBacking>
Oct 26 06:22:03 user nova-compute[74295]:   <devices>
Oct 26 06:22:03 user nova-compute[74295]:     <disk supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='diskDevice'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>disk</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cdrom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>floppy</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>lun</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='bus'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ide</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>fdc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sata</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </disk>
Oct 26 06:22:03 user nova-compute[74295]:     <graphics supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sdl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vnc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>spice</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egl-headless</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </graphics>
Oct 26 06:22:03 user nova-compute[74295]:     <video supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='modelType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cirrus</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vmvga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>qxl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>none</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>bochs</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ramfb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </video>
Oct 26 06:22:03 user nova-compute[74295]:     <hostdev supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='mode'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>subsystem</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='startupPolicy'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>default</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>mandatory</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>requisite</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>optional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='subsysType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pci</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='capsType'/>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='pciBackend'/>
Oct 26 06:22:03 user nova-compute[74295]:     </hostdev>
Oct 26 06:22:03 user nova-compute[74295]:     <rng supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>random</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egd</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>builtin</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </rng>
Oct 26 06:22:03 user nova-compute[74295]:     <filesystem supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='driverType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>path</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>handle</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtiofs</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </filesystem>
Oct 26 06:22:03 user nova-compute[74295]:     <tpm supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-tis</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-crb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>passthrough</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>emulator</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </tpm>
Oct 26 06:22:03 user nova-compute[74295]:   </devices>
Oct 26 06:22:03 user nova-compute[74295]:   <features>
Oct 26 06:22:03 user nova-compute[74295]:     <gic supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     <vmcoreinfo supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <genid supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backingStoreInput supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backup supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <sev supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:   </features>
Oct 26 06:22:03 user nova-compute[74295]: </domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:  {{(pid=74295) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 26 06:22:03 user nova-compute[74295]: <domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 06:22:03 user nova-compute[74295]:   <domain>kvm</domain>
Oct 26 06:22:03 user nova-compute[74295]:   <machine>pc-q35-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:   <arch>i686</arch>
Oct 26 06:22:03 user nova-compute[74295]:   <vcpu max='288'/>
Oct 26 06:22:03 user nova-compute[74295]:   <iothreads supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:   <os supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='firmware'/>
Oct 26 06:22:03 user nova-compute[74295]:     <loader supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>rom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pflash</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='readonly'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='secure'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </loader>
Oct 26 06:22:03 user nova-compute[74295]:   </os>
Oct 26 06:22:03 user nova-compute[74295]:   <cpu>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-passthrough' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='hostPassthroughMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='maximum' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='maximumMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-model' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <vendor>Intel</vendor>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ss'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='vmx'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pcid'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='hypervisor'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arat'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='umip'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='md-clear'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibpb'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibrs'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='erms'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='lm'/>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='custom' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>qemu64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>qemu32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>phenom</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>n270</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>kvm64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>coreduo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>core2duo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>athlon</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Westmere</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Snowridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Penryn</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G5</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G4</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G1</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Nehalem</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Rome</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Milan</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Dhyana</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cooperlake</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Conroe</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>486</model>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:   </cpu>
Oct 26 06:22:03 user nova-compute[74295]:   <memoryBacking supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='sourceType'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>file</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>anonymous</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>memfd</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:   </memoryBacking>
Oct 26 06:22:03 user nova-compute[74295]:   <devices>
Oct 26 06:22:03 user nova-compute[74295]:     <disk supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='diskDevice'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>disk</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cdrom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>floppy</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>lun</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='bus'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>fdc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sata</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </disk>
Oct 26 06:22:03 user nova-compute[74295]:     <graphics supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sdl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vnc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>spice</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egl-headless</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </graphics>
Oct 26 06:22:03 user nova-compute[74295]:     <video supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='modelType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cirrus</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vmvga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>qxl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>none</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>bochs</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ramfb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </video>
Oct 26 06:22:03 user nova-compute[74295]:     <hostdev supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='mode'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>subsystem</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='startupPolicy'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>default</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>mandatory</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>requisite</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>optional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='subsysType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pci</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='capsType'/>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='pciBackend'/>
Oct 26 06:22:03 user nova-compute[74295]:     </hostdev>
Oct 26 06:22:03 user nova-compute[74295]:     <rng supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>random</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egd</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>builtin</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </rng>
Oct 26 06:22:03 user nova-compute[74295]:     <filesystem supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='driverType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>path</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>handle</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtiofs</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </filesystem>
Oct 26 06:22:03 user nova-compute[74295]:     <tpm supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-tis</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-crb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>passthrough</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>emulator</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </tpm>
Oct 26 06:22:03 user nova-compute[74295]:   </devices>
Oct 26 06:22:03 user nova-compute[74295]:   <features>
Oct 26 06:22:03 user nova-compute[74295]:     <gic supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     <vmcoreinfo supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <genid supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backingStoreInput supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backup supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <sev supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:   </features>
Oct 26 06:22:03 user nova-compute[74295]: </domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:  {{(pid=74295) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 26 06:22:03 user nova-compute[74295]: <domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 06:22:03 user nova-compute[74295]:   <domain>kvm</domain>
Oct 26 06:22:03 user nova-compute[74295]:   <machine>pc-q35-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:   <arch>x86_64</arch>
Oct 26 06:22:03 user nova-compute[74295]:   <vcpu max='288'/>
Oct 26 06:22:03 user nova-compute[74295]:   <iothreads supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:   <os supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='firmware'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>efi</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:     <loader supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>rom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pflash</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='readonly'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='secure'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </loader>
Oct 26 06:22:03 user nova-compute[74295]:   </os>
Oct 26 06:22:03 user nova-compute[74295]:   <cpu>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-passthrough' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='hostPassthroughMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='maximum' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='maximumMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-model' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <vendor>Intel</vendor>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ss'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='vmx'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pcid'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='hypervisor'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arat'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='umip'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='md-clear'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='invtsc'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibpb'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibrs'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='rsba'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='erms'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='custom' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>qemu64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>qemu32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>phenom</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>n270</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>coreduo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>core2duo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>athlon</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Westmere</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Snowridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Penryn</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G5</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G4</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Opteron_G1</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Nehalem</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Rome</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Milan</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Dhyana</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cooperlake</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Conroe</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>486</model>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:   </cpu>
Oct 26 06:22:03 user nova-compute[74295]:   <memoryBacking supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='sourceType'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>file</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>anonymous</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>memfd</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:   </memoryBacking>
Oct 26 06:22:03 user nova-compute[74295]:   <devices>
Oct 26 06:22:03 user nova-compute[74295]:     <disk supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='diskDevice'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>disk</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cdrom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>floppy</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>lun</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='bus'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>fdc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sata</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </disk>
Oct 26 06:22:03 user nova-compute[74295]:     <graphics supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sdl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vnc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>spice</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egl-headless</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </graphics>
Oct 26 06:22:03 user nova-compute[74295]:     <video supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='modelType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cirrus</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vmvga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>qxl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>none</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>bochs</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ramfb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </video>
Oct 26 06:22:03 user nova-compute[74295]:     <hostdev supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='mode'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>subsystem</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='startupPolicy'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>default</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>mandatory</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>requisite</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>optional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='subsysType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pci</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='capsType'/>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='pciBackend'/>
Oct 26 06:22:03 user nova-compute[74295]:     </hostdev>
Oct 26 06:22:03 user nova-compute[74295]:     <rng supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>random</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egd</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>builtin</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </rng>
Oct 26 06:22:03 user nova-compute[74295]:     <filesystem supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='driverType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>path</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>handle</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtiofs</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </filesystem>
Oct 26 06:22:03 user nova-compute[74295]:     <tpm supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-tis</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-crb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>passthrough</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>emulator</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </tpm>
Oct 26 06:22:03 user nova-compute[74295]:   </devices>
Oct 26 06:22:03 user nova-compute[74295]:   <features>
Oct 26 06:22:03 user nova-compute[74295]:     <gic supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     <vmcoreinfo supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <genid supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backingStoreInput supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backup supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <sev supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:   </features>
Oct 26 06:22:03 user nova-compute[74295]: </domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:  {{(pid=74295) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 26 06:22:03 user nova-compute[74295]: <domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 06:22:03 user nova-compute[74295]:   <domain>kvm</domain>
Oct 26 06:22:03 user nova-compute[74295]:   <machine>pc-i440fx-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:   <arch>x86_64</arch>
Oct 26 06:22:03 user nova-compute[74295]:   <vcpu max='255'/>
Oct 26 06:22:03 user nova-compute[74295]:   <iothreads supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:   <os supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='firmware'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>efi</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:     <loader supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>rom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pflash</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='readonly'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='secure'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </loader>
Oct 26 06:22:03 user nova-compute[74295]:   </os>
Oct 26 06:22:03 user nova-compute[74295]:   <cpu>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-passthrough' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='hostPassthroughMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='maximum' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='maximumMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-model' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <vendor>Intel</vendor>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ss'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='vmx'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pcid'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='hypervisor'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arat'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='umip'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='md-clear'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='invtsc'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibpb'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibrs'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='rsba'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='erms'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='custom' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>qemu64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>qemu32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>phenom</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>n270</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>coreduo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>core2duo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>athlon</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Westmere</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Snowridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Penryn</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G5</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G4</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Opteron_G1</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Nehalem</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Rome</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Milan</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Dhyana</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cooperlake</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Conroe</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>486</model>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:   </cpu>
Oct 26 06:22:03 user nova-compute[74295]:   <memoryBacking supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='sourceType'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>file</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>anonymous</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>memfd</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:   </memoryBacking>
Oct 26 06:22:03 user nova-compute[74295]:   <devices>
Oct 26 06:22:03 user nova-compute[74295]:     <disk supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='diskDevice'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>disk</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cdrom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>floppy</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>lun</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='bus'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ide</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>fdc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sata</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </disk>
Oct 26 06:22:03 user nova-compute[74295]:     <graphics supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sdl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vnc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>spice</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egl-headless</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </graphics>
Oct 26 06:22:03 user nova-compute[74295]:     <video supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='modelType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cirrus</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vmvga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>qxl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>none</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>bochs</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ramfb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </video>
Oct 26 06:22:03 user nova-compute[74295]:     <hostdev supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='mode'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>subsystem</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='startupPolicy'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>default</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>mandatory</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>requisite</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>optional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='subsysType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pci</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='capsType'/>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='pciBackend'/>
Oct 26 06:22:03 user nova-compute[74295]:     </hostdev>
Oct 26 06:22:03 user nova-compute[74295]:     <rng supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>random</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egd</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>builtin</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </rng>
Oct 26 06:22:03 user nova-compute[74295]:     <filesystem supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='driverType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>path</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>handle</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtiofs</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </filesystem>
Oct 26 06:22:03 user nova-compute[74295]:     <tpm supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-tis</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-crb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>passthrough</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>emulator</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </tpm>
Oct 26 06:22:03 user nova-compute[74295]:   </devices>
Oct 26 06:22:03 user nova-compute[74295]:   <features>
Oct 26 06:22:03 user nova-compute[74295]:     <gic supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     <vmcoreinfo supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <genid supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backingStoreInput supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backup supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <sev supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:   </features>
Oct 26 06:22:03 user nova-compute[74295]: </domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:  {{(pid=74295) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 26 06:22:03 user nova-compute[74295]: <domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 06:22:03 user nova-compute[74295]:   <domain>kvm</domain>
Oct 26 06:22:03 user nova-compute[74295]:   <machine>pc-i440fx-jammy</machine>
Oct 26 06:22:03 user nova-compute[74295]:   <arch>x86_64</arch>
Oct 26 06:22:03 user nova-compute[74295]:   <vcpu max='255'/>
Oct 26 06:22:03 user nova-compute[74295]:   <iothreads supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:   <os supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='firmware'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>efi</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:     <loader supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>rom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pflash</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='readonly'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='secure'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </loader>
Oct 26 06:22:03 user nova-compute[74295]:   </os>
Oct 26 06:22:03 user nova-compute[74295]:   <cpu>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-passthrough' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='hostPassthroughMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='maximum' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='maximumMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-model' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <vendor>Intel</vendor>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ss'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='vmx'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pcid'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='hypervisor'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arat'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='umip'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='md-clear'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='invtsc'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibpb'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibrs'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='rsba'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='erms'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='custom' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>qemu64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>qemu32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>phenom</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>n270</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>coreduo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>core2duo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>athlon</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Westmere</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Snowridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Penryn</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G5</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G4</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Opteron_G1</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Nehalem</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Rome</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Milan</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Dhyana</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cooperlake</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Conroe</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>486</model>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:   </cpu>
Oct 26 06:22:03 user nova-compute[74295]:   <memoryBacking supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='sourceType'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>file</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>anonymous</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>memfd</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:   </memoryBacking>
Oct 26 06:22:03 user nova-compute[74295]:   <devices>
Oct 26 06:22:03 user nova-compute[74295]:     <disk supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='diskDevice'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>disk</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cdrom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>floppy</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>lun</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='bus'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ide</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>fdc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sata</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </disk>
Oct 26 06:22:03 user nova-compute[74295]:     <graphics supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sdl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vnc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>spice</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egl-headless</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </graphics>
Oct 26 06:22:03 user nova-compute[74295]:     <video supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='modelType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cirrus</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vmvga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>qxl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>none</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>bochs</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ramfb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </video>
Oct 26 06:22:03 user nova-compute[74295]:     <hostdev supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='mode'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>subsystem</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='startupPolicy'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>default</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>mandatory</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>requisite</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>optional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='subsysType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pci</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='capsType'/>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='pciBackend'/>
Oct 26 06:22:03 user nova-compute[74295]:     </hostdev>
Oct 26 06:22:03 user nova-compute[74295]:     <rng supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>random</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egd</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>builtin</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </rng>
Oct 26 06:22:03 user nova-compute[74295]:     <filesystem supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='driverType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>path</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>handle</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtiofs</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </filesystem>
Oct 26 06:22:03 user nova-compute[74295]:     <tpm supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-tis</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-crb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>passthrough</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>emulator</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </tpm>
Oct 26 06:22:03 user nova-compute[74295]:   </devices>
Oct 26 06:22:03 user nova-compute[74295]:   <features>
Oct 26 06:22:03 user nova-compute[74295]:     <gic supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     <vmcoreinfo supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <genid supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backingStoreInput supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backup supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <sev supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:   </features>
Oct 26 06:22:03 user nova-compute[74295]: </domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:  {{(pid=74295) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 26 06:22:03 user nova-compute[74295]: <domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 06:22:03 user nova-compute[74295]:   <domain>kvm</domain>
Oct 26 06:22:03 user nova-compute[74295]:   <machine>pc-q35-6.2</machine>
Oct 26 06:22:03 user nova-compute[74295]:   <arch>x86_64</arch>
Oct 26 06:22:03 user nova-compute[74295]:   <vcpu max='288'/>
Oct 26 06:22:03 user nova-compute[74295]:   <iothreads supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:   <os supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='firmware'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>efi</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:     <loader supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>rom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pflash</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='readonly'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='secure'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>yes</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>no</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </loader>
Oct 26 06:22:03 user nova-compute[74295]:   </os>
Oct 26 06:22:03 user nova-compute[74295]:   <cpu>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-passthrough' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='hostPassthroughMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='maximum' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='maximumMigratable'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>on</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>off</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='host-model' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <vendor>Intel</vendor>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ss'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='vmx'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pcid'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='hypervisor'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arat'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='umip'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='md-clear'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='invtsc'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibpb'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='ibrs'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-stibp'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='rsba'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='erms'/>
Oct 26 06:22:03 user nova-compute[74295]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:     <mode name='custom' supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>qemu64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>qemu32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>phenom</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>pentium</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>n270</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm64</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>kvm32</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>coreduo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>core2duo</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>athlon</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Westmere</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Snowridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Skylake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>SandyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Penryn</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G5</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G4</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G3</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Opteron_G2</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Opteron_G1</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Nehalem</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>IvyBridge</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Icelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Haswell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Rome</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-Milan</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>EPYC</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Dhyana</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cooperlake</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>Conroe</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='no'>Broadwell</model>
Oct 26 06:22:03 user nova-compute[74295]:       <model usable='yes'>486</model>
Oct 26 06:22:03 user nova-compute[74295]:     </mode>
Oct 26 06:22:03 user nova-compute[74295]:   </cpu>
Oct 26 06:22:03 user nova-compute[74295]:   <memoryBacking supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:     <enum name='sourceType'>
Oct 26 06:22:03 user nova-compute[74295]:       <value>file</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>anonymous</value>
Oct 26 06:22:03 user nova-compute[74295]:       <value>memfd</value>
Oct 26 06:22:03 user nova-compute[74295]:     </enum>
Oct 26 06:22:03 user nova-compute[74295]:   </memoryBacking>
Oct 26 06:22:03 user nova-compute[74295]:   <devices>
Oct 26 06:22:03 user nova-compute[74295]:     <disk supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='diskDevice'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>disk</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cdrom</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>floppy</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>lun</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='bus'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>fdc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sata</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </disk>
Oct 26 06:22:03 user nova-compute[74295]:     <graphics supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='type'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>sdl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vnc</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>spice</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egl-headless</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </graphics>
Oct 26 06:22:03 user nova-compute[74295]:     <video supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='modelType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>cirrus</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>vmvga</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>qxl</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>none</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>bochs</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>ramfb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </video>
Oct 26 06:22:03 user nova-compute[74295]:     <hostdev supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='mode'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>subsystem</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='startupPolicy'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>default</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>mandatory</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>requisite</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>optional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='subsysType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>usb</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>pci</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>scsi</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='capsType'/>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='pciBackend'/>
Oct 26 06:22:03 user nova-compute[74295]:     </hostdev>
Oct 26 06:22:03 user nova-compute[74295]:     <rng supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtio-non-transitional</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>random</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>egd</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>builtin</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </rng>
Oct 26 06:22:03 user nova-compute[74295]:     <filesystem supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='driverType'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>path</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>handle</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>virtiofs</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </filesystem>
Oct 26 06:22:03 user nova-compute[74295]:     <tpm supported='yes'>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='model'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-tis</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>tpm-crb</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:       <enum name='backendModel'>
Oct 26 06:22:03 user nova-compute[74295]:         <value>passthrough</value>
Oct 26 06:22:03 user nova-compute[74295]:         <value>emulator</value>
Oct 26 06:22:03 user nova-compute[74295]:       </enum>
Oct 26 06:22:03 user nova-compute[74295]:     </tpm>
Oct 26 06:22:03 user nova-compute[74295]:   </devices>
Oct 26 06:22:03 user nova-compute[74295]:   <features>
Oct 26 06:22:03 user nova-compute[74295]:     <gic supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:     <vmcoreinfo supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <genid supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backingStoreInput supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <backup supported='yes'/>
Oct 26 06:22:03 user nova-compute[74295]:     <sev supported='no'/>
Oct 26 06:22:03 user nova-compute[74295]:   </features>
Oct 26 06:22:03 user nova-compute[74295]: </domainCapabilities>
Oct 26 06:22:03 user nova-compute[74295]:  {{(pid=74295) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74295) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74295) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Checking secure boot support for host arch (x86_64) {{(pid=74295) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 06:22:03 user nova-compute[74295]: INFO nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Secure Boot support detected
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] cpu compare xml: <cpu match="exact">
Oct 26 06:22:03 user nova-compute[74295]:   <model>Nehalem</model>
Oct 26 06:22:03 user nova-compute[74295]: </cpu>
Oct 26 06:22:03 user nova-compute[74295]:  {{(pid=74295) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 26 06:22:03 user nova-compute[74295]: INFO nova.virt.node [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Generated node identity 83a4b092-caa9-49fc-b639-9b9bc5d3ce84
Oct 26 06:22:03 user nova-compute[74295]: INFO nova.virt.node [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Wrote node identity 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 to /opt/stack/data/nova/compute_id
Oct 26 06:22:03 user nova-compute[74295]: WARNING nova.compute.manager [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Compute nodes ['83a4b092-caa9-49fc-b639-9b9bc5d3ce84'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 26 06:22:03 user nova-compute[74295]: INFO nova.compute.manager [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 26 06:22:03 user nova-compute[74295]: WARNING nova.compute.manager [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 06:22:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:22:03 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:22:04 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:22:04 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Hypervisor/Node resource view: name=user free_ram=10941MB free_disk=26.194515228271484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:22:04 user nova-compute[74295]: WARNING nova.compute.resource_tracker [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] No compute node record for user:83a4b092-caa9-49fc-b639-9b9bc5d3ce84: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 could not be found.
Oct 26 06:22:04 user nova-compute[74295]: INFO nova.compute.resource_tracker [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Compute node record created for user:user with uuid: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:22:04 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] [req-0803b7e9-eaaa-452a-8c02-a179cfa24527] Created resource provider record via placement API for resource provider with UUID 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 and name user.
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74295) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 26 06:22:04 user nova-compute[74295]: INFO nova.virt.libvirt.host [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] kernel doesn't support AMD SEV
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Libvirt baseline CPU <cpu>
Oct 26 06:22:04 user nova-compute[74295]:   <arch>x86_64</arch>
Oct 26 06:22:04 user nova-compute[74295]:   <model>Nehalem</model>
Oct 26 06:22:04 user nova-compute[74295]:   <vendor>Intel</vendor>
Oct 26 06:22:04 user nova-compute[74295]:   <topology sockets="6" cores="1" threads="1"/>
Oct 26 06:22:04 user nova-compute[74295]: </cpu>
Oct 26 06:22:04 user nova-compute[74295]:  {{(pid=74295) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Updated inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Updating resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 generation from 0 to 1 during operation: update_inventory {{(pid=74295) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Updating resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 generation from 1 to 2 during operation: update_traits {{(pid=74295) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:22:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:22:05 user nova-compute[74295]: DEBUG nova.service [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Creating RPC server for service compute {{(pid=74295) start /opt/stack/nova/nova/service.py:182}}
Oct 26 06:22:05 user nova-compute[74295]: DEBUG nova.service [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] Join ServiceGroup membership for this service compute {{(pid=74295) start /opt/stack/nova/nova/service.py:199}}
Oct 26 06:22:05 user nova-compute[74295]: DEBUG nova.servicegroup.drivers.db [None req-013a422d-09ae-48b3-b1d6-1e7aaf06e110 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74295) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_power_states {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:22:55 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:22:55 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:22:55 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=10366MB free_disk=26.098182678222656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:22:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:22:56 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:22:56 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:22:56 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:22:56 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:22:56 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:22:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:23:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:23:57 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:23:57 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:23:57 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=10297MB free_disk=26.162120819091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:23:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:23:58 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:23:58 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:23:58 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:23:58 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:23:58 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:23:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:24:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:24:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:24:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:24:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:24:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:24:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:24:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:24:58 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:24:58 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:24:58 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:24:58 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:24:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:24:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:24:59 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=10319MB free_disk=25.9158935546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:24:59 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:25:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:25:00 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:25:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:25:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:25:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:25:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:25:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:25:58 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:25:58 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:25:58 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:25:58 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:25:59 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:25:59 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:25:59 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:25:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:25:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:25:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:25:59 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:25:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:25:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:25:59 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=9596MB free_disk=25.935932159423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:25:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:25:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:00 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:26:00 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:26:00 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:00 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:26:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:01 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:26:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:26:01 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:06 user nova-compute[74295]: INFO nova.compute.claims [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Claim successful on node user
Oct 26 06:26:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "c002695d-145c-4e74-90ae-aa1133680472" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.202s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:06 user nova-compute[74295]: INFO nova.compute.claims [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Claim successful on node user
Oct 26 06:26:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Creating image(s)
Oct 26 06:26:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "/opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "/opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "/opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.policy [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '969b88effa7b4c14a9fdca34760804e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac89a741e94482bf18b56aca6a53c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.policy [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f168b3483604503af2d33a547c2b315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9afa806421043ee97a8bbec1a71d65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Creating image(s)
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "/opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "/opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "/opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799.part --force-share --output=json" returned: 0 in 0.245s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.virt.images [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120 was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799.part /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:08 user nova-compute[74295]: INFO nova.compute.claims [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Claim successful on node user
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799.part /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799.converted" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.218s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:08 user nova-compute[74295]: INFO oslo.privsep.daemon [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpg8tav0d4/privsep.sock']
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.422s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:08 user sudo[83794]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpg8tav0d4/privsep.sock
Oct 26 06:26:08 user sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.213s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:08 user nova-compute[74295]: INFO nova.compute.claims [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Claim successful on node user
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.policy [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b0e86cf3ec049a58aee69c427717598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c33a42f4b946d28de9e355927737e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:09 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Creating image(s)
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.571s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:09 user nova-compute[74295]: INFO nova.compute.claims [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Claim successful on node user
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Successfully created port: 85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:09 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.policy [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e44a6886b2b478dbca031edd15a9a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8a2b9f8cce49d4985549fd42dc1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:09 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Creating image(s)
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "/opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "/opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "/opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:09 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:09 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Creating image(s)
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:09 user nova-compute[74295]: DEBUG nova.policy [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b0e86cf3ec049a58aee69c427717598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c33a42f4b946d28de9e355927737e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:09 user sudo[83794]: pam_unix(sudo:session): session closed for user root
Oct 26 06:26:09 user nova-compute[74295]: INFO oslo.privsep.daemon [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Spawned new privsep daemon via rootwrap
Oct 26 06:26:09 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 06:26:09 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 06:26:09 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 26 06:26:09 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83798
Oct 26 06:26:09 user nova-compute[74295]: WARNING oslo_privsep.priv_context [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] privsep daemon already running
Oct 26 06:26:09 user nova-compute[74295]: WARNING oslo_privsep.priv_context [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] privsep daemon already running
Oct 26 06:26:09 user nova-compute[74295]: WARNING oslo_privsep.priv_context [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] privsep daemon already running
Oct 26 06:26:09 user nova-compute[74295]: WARNING oslo_privsep.priv_context [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] privsep daemon already running
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.171s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.205s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.157s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk 1073741824" returned: 0 in 0.041s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.196s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Successfully created port: 88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Successfully created port: fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.212s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk 1073741824" returned: 0 in 0.044s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.442s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Cannot resize image /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Ensure instance console log exists: /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.200s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk 1073741824" returned: 0 in 0.040s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.700s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Cannot resize image /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Ensure instance console log exists: /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.154s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk 1073741824" returned: 0 in 0.062s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.925s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Successfully created port: f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Cannot resize image /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Ensure instance console log exists: /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk 1073741824" returned: 0 in 0.064s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Cannot resize image /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Ensure instance console log exists: /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Successfully updated port: 85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquired lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Cannot resize image /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Ensure instance console log exists: /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-49bff834-0c56-4ee5-9c06-9cb672064785 req-3bbd8f53-3bc7-40fc-bbc4-492ffc215bd0 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received event network-changed-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-49bff834-0c56-4ee5-9c06-9cb672064785 req-3bbd8f53-3bc7-40fc-bbc4-492ffc215bd0 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Refreshing instance network info cache due to event network-changed-85b8870e-a0e3-4389-81c3-ce5277631633. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-49bff834-0c56-4ee5-9c06-9cb672064785 req-3bbd8f53-3bc7-40fc-bbc4-492ffc215bd0 service nova] Acquiring lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Successfully created port: 8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:12 user nova-compute[74295]: INFO nova.compute.claims [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Claim successful on node user
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Successfully updated port: 88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "refresh_cache-c47a4c17-13ba-47af-9979-db4ddfc6dc46" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquired lock "refresh_cache-c47a4c17-13ba-47af-9979-db4ddfc6dc46" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Creating image(s)
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "/opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "/opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "/opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updating instance_info_cache with network_info: [{"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Releasing lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Instance network_info: |[{"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-49bff834-0c56-4ee5-9c06-9cb672064785 req-3bbd8f53-3bc7-40fc-bbc4-492ffc215bd0 service nova] Acquired lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.neutron [req-49bff834-0c56-4ee5-9c06-9cb672064785 req-3bbd8f53-3bc7-40fc-bbc4-492ffc215bd0 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Refreshing network info cache for port 85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Start _get_guest_xml network_info=[{"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:13 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:13 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-cde54d87-7e93-454e-a47e-52eedc77b868 req-a281afad-4a97-4be5-9a61-8532033e069a service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received event network-changed-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-cde54d87-7e93-454e-a47e-52eedc77b868 req-a281afad-4a97-4be5-9a61-8532033e069a service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Refreshing instance network info cache due to event network-changed-88b99f5b-7929-4948-8f2a-48c8d765b554. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cde54d87-7e93-454e-a47e-52eedc77b868 req-a281afad-4a97-4be5-9a61-8532033e069a service nova] Acquiring lock "refresh_cache-c47a4c17-13ba-47af-9979-db4ddfc6dc46" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.policy [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3c3d6fa25d143bc935e7e16275aac57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b6035868e347c4b90651f3ad73237a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-115586872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-115586872',id=2,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-ad8ue8iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:08Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=c002695d-145c-4e74-90ae-aa1133680472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:2c,bridge_name='br-int',has_traffic_filtering=True,id=85b8870e-a0e3-4389-81c3-ce5277631633,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b8870e-a0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'pci_devices' on Instance uuid c002695d-145c-4e74-90ae-aa1133680472 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Successfully updated port: fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:13 user nova-compute[74295]:   <uuid>c002695d-145c-4e74-90ae-aa1133680472</uuid>
Oct 26 06:26:13 user nova-compute[74295]:   <name>instance-00000002</name>
Oct 26 06:26:13 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:13 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:13 user nova-compute[74295]:   <metadata>
Oct 26 06:26:13 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:13 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:13 user nova-compute[74295]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-115586872</nova:name>
Oct 26 06:26:13 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:13</nova:creationTime>
Oct 26 06:26:13 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:13 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:13 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:13 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:13 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:13 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:13 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:13 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:13 user nova-compute[74295]:         <nova:user uuid="969b88effa7b4c14a9fdca34760804e8">tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member</nova:user>
Oct 26 06:26:13 user nova-compute[74295]:         <nova:project uuid="e0ac89a741e94482bf18b56aca6a53c1">tempest-ServerBootFromVolumeStableRescueTest-1259261992</nova:project>
Oct 26 06:26:13 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:13 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:26:13 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:13 user nova-compute[74295]:         <nova:port uuid="85b8870e-a0e3-4389-81c3-ce5277631633">
Oct 26 06:26:13 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 06:26:13 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:13 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:13 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:13 user nova-compute[74295]:   </metadata>
Oct 26 06:26:13 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:13 user nova-compute[74295]:     <system>
Oct 26 06:26:13 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:13 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:13 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:13 user nova-compute[74295]:       <entry name="serial">c002695d-145c-4e74-90ae-aa1133680472</entry>
Oct 26 06:26:13 user nova-compute[74295]:       <entry name="uuid">c002695d-145c-4e74-90ae-aa1133680472</entry>
Oct 26 06:26:13 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:13 user nova-compute[74295]:     </system>
Oct 26 06:26:13 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:13 user nova-compute[74295]:   <os>
Oct 26 06:26:13 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:13 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:13 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:13 user nova-compute[74295]:   </os>
Oct 26 06:26:13 user nova-compute[74295]:   <features>
Oct 26 06:26:13 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:13 user nova-compute[74295]:     <apic/>
Oct 26 06:26:13 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:13 user nova-compute[74295]:   </features>
Oct 26 06:26:13 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:13 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:13 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:13 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:13 user nova-compute[74295]:   </clock>
Oct 26 06:26:13 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:13 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:13 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:13 user nova-compute[74295]:   </cpu>
Oct 26 06:26:13 user nova-compute[74295]:   <devices>
Oct 26 06:26:13 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:13 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:13 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk"/>
Oct 26 06:26:13 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:26:13 user nova-compute[74295]:     </disk>
Oct 26 06:26:13 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:13 user nova-compute[74295]:       <mac address="fa:16:3e:32:99:2c"/>
Oct 26 06:26:13 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:13 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:13 user nova-compute[74295]:       <target dev="tap85b8870e-a0"/>
Oct 26 06:26:13 user nova-compute[74295]:     </interface>
Oct 26 06:26:13 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:13 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/console.log" append="off"/>
Oct 26 06:26:13 user nova-compute[74295]:     </serial>
Oct 26 06:26:13 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:13 user nova-compute[74295]:     <video>
Oct 26 06:26:13 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:13 user nova-compute[74295]:     </video>
Oct 26 06:26:13 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:13 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:13 user nova-compute[74295]:     </rng>
Oct 26 06:26:13 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:13 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:13 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:13 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:13 user nova-compute[74295]:   </devices>
Oct 26 06:26:13 user nova-compute[74295]: </domain>
Oct 26 06:26:13 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-115586872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-115586872',id=2,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-ad8ue8iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:08Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=c002695d-145c-4e74-90ae-aa1133680472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:2c,bridge_name='br-int',has_traffic_filtering=True,id=85b8870e-a0e3-4389-81c3-ce5277631633,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b8870e-a0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG os_vif [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:2c,bridge_name='br-int',has_traffic_filtering=True,id=85b8870e-a0e3-4389-81c3-ce5277631633,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b8870e-a0') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Created schema index Interface.name {{(pid=74295) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Created schema index Port.name {{(pid=74295) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Created schema index Bridge.name {{(pid=74295) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.369s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [POLLOUT] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquired lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60921d06-280c-5b6f-92a6-20aea3a1456b', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:13 user nova-compute[74295]: INFO oslo.privsep.daemon [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpifnbw8ob/privsep.sock']
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.155s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:13 user sudo[83890]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpifnbw8ob/privsep.sock
Oct 26 06:26:13 user sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-79ce3c33-96e6-44c9-aaa4-0879bdbed47c req-e8c11cc9-cccd-44bd-88ab-865eabd1d73c service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-changed-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-79ce3c33-96e6-44c9-aaa4-0879bdbed47c req-e8c11cc9-cccd-44bd-88ab-865eabd1d73c service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Refreshing instance network info cache due to event network-changed-fbea3168-b2c6-4ca2-bad1-949003900aa0. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-79ce3c33-96e6-44c9-aaa4-0879bdbed47c req-e8c11cc9-cccd-44bd-88ab-865eabd1d73c service nova] Acquiring lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk 1073741824" returned: 0 in 0.061s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Cannot resize image /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Ensure instance console log exists: /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Updating instance_info_cache with network_info: [{"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Releasing lock "refresh_cache-c47a4c17-13ba-47af-9979-db4ddfc6dc46" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Instance network_info: |[{"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cde54d87-7e93-454e-a47e-52eedc77b868 req-a281afad-4a97-4be5-9a61-8532033e069a service nova] Acquired lock "refresh_cache-c47a4c17-13ba-47af-9979-db4ddfc6dc46" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.neutron [req-cde54d87-7e93-454e-a47e-52eedc77b868 req-a281afad-4a97-4be5-9a61-8532033e069a service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Refreshing network info cache for port 88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Start _get_guest_xml network_info=[{"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1573172271',display_name='tempest-DeleteServersTestJSON-server-1573172271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1573172271',id=1,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9afa806421043ee97a8bbec1a71d65a',ramdisk_id='',reservation_id='r-gh9xe1of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-84553156',owner_user_name='tempest-DeleteServersTestJSON-84553156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:07Z,user_data=None,user_id='5f168b3483604503af2d33a547c2b315',uuid=c47a4c17-13ba-47af-9979-db4ddfc6dc46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Converting VIF {"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:1d:9b,bridge_name='br-int',has_traffic_filtering=True,id=88b99f5b-7929-4948-8f2a-48c8d765b554,network=Network(0999bd3c-3495-4ff8-9d4f-68def80a64be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99f5b-79') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lazy-loading 'pci_devices' on Instance uuid c47a4c17-13ba-47af-9979-db4ddfc6dc46 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:14 user nova-compute[74295]:   <uuid>c47a4c17-13ba-47af-9979-db4ddfc6dc46</uuid>
Oct 26 06:26:14 user nova-compute[74295]:   <name>instance-00000001</name>
Oct 26 06:26:14 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:14 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:14 user nova-compute[74295]:   <metadata>
Oct 26 06:26:14 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:14 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:14 user nova-compute[74295]:       <nova:name>tempest-DeleteServersTestJSON-server-1573172271</nova:name>
Oct 26 06:26:14 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:14</nova:creationTime>
Oct 26 06:26:14 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:14 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:14 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:14 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:14 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:14 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:14 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:14 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:14 user nova-compute[74295]:         <nova:user uuid="5f168b3483604503af2d33a547c2b315">tempest-DeleteServersTestJSON-84553156-project-member</nova:user>
Oct 26 06:26:14 user nova-compute[74295]:         <nova:project uuid="a9afa806421043ee97a8bbec1a71d65a">tempest-DeleteServersTestJSON-84553156</nova:project>
Oct 26 06:26:14 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:14 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:26:14 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:14 user nova-compute[74295]:         <nova:port uuid="88b99f5b-7929-4948-8f2a-48c8d765b554">
Oct 26 06:26:14 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 06:26:14 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:14 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:14 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:14 user nova-compute[74295]:   </metadata>
Oct 26 06:26:14 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:14 user nova-compute[74295]:     <system>
Oct 26 06:26:14 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:14 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:14 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:14 user nova-compute[74295]:       <entry name="serial">c47a4c17-13ba-47af-9979-db4ddfc6dc46</entry>
Oct 26 06:26:14 user nova-compute[74295]:       <entry name="uuid">c47a4c17-13ba-47af-9979-db4ddfc6dc46</entry>
Oct 26 06:26:14 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:14 user nova-compute[74295]:     </system>
Oct 26 06:26:14 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:14 user nova-compute[74295]:   <os>
Oct 26 06:26:14 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:14 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:14 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:14 user nova-compute[74295]:   </os>
Oct 26 06:26:14 user nova-compute[74295]:   <features>
Oct 26 06:26:14 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:14 user nova-compute[74295]:     <apic/>
Oct 26 06:26:14 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:14 user nova-compute[74295]:   </features>
Oct 26 06:26:14 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:14 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:14 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:14 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:14 user nova-compute[74295]:   </clock>
Oct 26 06:26:14 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:14 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:14 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:14 user nova-compute[74295]:   </cpu>
Oct 26 06:26:14 user nova-compute[74295]:   <devices>
Oct 26 06:26:14 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:14 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:14 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk"/>
Oct 26 06:26:14 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:26:14 user nova-compute[74295]:     </disk>
Oct 26 06:26:14 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:14 user nova-compute[74295]:       <mac address="fa:16:3e:53:1d:9b"/>
Oct 26 06:26:14 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:14 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:14 user nova-compute[74295]:       <target dev="tap88b99f5b-79"/>
Oct 26 06:26:14 user nova-compute[74295]:     </interface>
Oct 26 06:26:14 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:14 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/console.log" append="off"/>
Oct 26 06:26:14 user nova-compute[74295]:     </serial>
Oct 26 06:26:14 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:14 user nova-compute[74295]:     <video>
Oct 26 06:26:14 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:14 user nova-compute[74295]:     </video>
Oct 26 06:26:14 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:14 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:14 user nova-compute[74295]:     </rng>
Oct 26 06:26:14 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:14 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:14 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:14 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:14 user nova-compute[74295]:   </devices>
Oct 26 06:26:14 user nova-compute[74295]: </domain>
Oct 26 06:26:14 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1573172271',display_name='tempest-DeleteServersTestJSON-server-1573172271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1573172271',id=1,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9afa806421043ee97a8bbec1a71d65a',ramdisk_id='',reservation_id='r-gh9xe1of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-84553156',owner_user_name='tempest-DeleteServersTestJSON-84553156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:07Z,user_data=None,user_id='5f168b3483604503af2d33a547c2b315',uuid=c47a4c17-13ba-47af-9979-db4ddfc6dc46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Converting VIF {"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:1d:9b,bridge_name='br-int',has_traffic_filtering=True,id=88b99f5b-7929-4948-8f2a-48c8d765b554,network=Network(0999bd3c-3495-4ff8-9d4f-68def80a64be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99f5b-79') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG os_vif [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:1d:9b,bridge_name='br-int',has_traffic_filtering=True,id=88b99f5b-7929-4948-8f2a-48c8d765b554,network=Network(0999bd3c-3495-4ff8-9d4f-68def80a64be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99f5b-79') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57bf538e-1d80-5b35-bb89-45a1f61edf01', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Successfully updated port: 8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquired lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Successfully updated port: f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquired lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:15 user sudo[83890]: pam_unix(sudo:session): session closed for user root
Oct 26 06:26:15 user nova-compute[74295]: INFO oslo.privsep.daemon [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Spawned new privsep daemon via rootwrap
Oct 26 06:26:15 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 06:26:15 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 06:26:15 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 26 06:26:15 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83904
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-49bff834-0c56-4ee5-9c06-9cb672064785 req-3bbd8f53-3bc7-40fc-bbc4-492ffc215bd0 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updated VIF entry in instance network info cache for port 85b8870e-a0e3-4389-81c3-ce5277631633. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-49bff834-0c56-4ee5-9c06-9cb672064785 req-3bbd8f53-3bc7-40fc-bbc4-492ffc215bd0 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updating instance_info_cache with network_info: [{"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:15 user nova-compute[74295]: WARNING oslo_privsep.priv_context [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] privsep daemon already running
Oct 26 06:26:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-49bff834-0c56-4ee5-9c06-9cb672064785 req-3bbd8f53-3bc7-40fc-bbc4-492ffc215bd0 service nova] Releasing lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-cde54d87-7e93-454e-a47e-52eedc77b868 req-a281afad-4a97-4be5-9a61-8532033e069a service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Updated VIF entry in instance network info cache for port 88b99f5b-7929-4948-8f2a-48c8d765b554. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-cde54d87-7e93-454e-a47e-52eedc77b868 req-a281afad-4a97-4be5-9a61-8532033e069a service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Updating instance_info_cache with network_info: [{"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updating instance_info_cache with network_info: [{"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cde54d87-7e93-454e-a47e-52eedc77b868 req-a281afad-4a97-4be5-9a61-8532033e069a service nova] Releasing lock "refresh_cache-c47a4c17-13ba-47af-9979-db4ddfc6dc46" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Releasing lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Instance network_info: |[{"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Start _get_guest_xml network_info=[{"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1772937373',display_name='tempest-ServerRescueNegativeTestJSON-server-1772937373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1772937373',id=5,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-a9t47yq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:10Z,user_data=None,user_id='3b0e86cf3ec049a58aee69c427717598',uuid=b1d6362b-2ffb-4574-8f19-48855f6e7869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f0a9975-465e-46c6-a0cf-777bcaf3a2df,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0a9975-46') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'pci_devices' on Instance uuid b1d6362b-2ffb-4574-8f19-48855f6e7869 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updating instance_info_cache with network_info: [{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:15 user nova-compute[74295]:   <uuid>b1d6362b-2ffb-4574-8f19-48855f6e7869</uuid>
Oct 26 06:26:15 user nova-compute[74295]:   <name>instance-00000005</name>
Oct 26 06:26:15 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:15 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:15 user nova-compute[74295]:   <metadata>
Oct 26 06:26:15 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:15 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1772937373</nova:name>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:15</nova:creationTime>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:15 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:15 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:user uuid="3b0e86cf3ec049a58aee69c427717598">tempest-ServerRescueNegativeTestJSON-1373728584-project-member</nova:user>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:project uuid="65c33a42f4b946d28de9e355927737e8">tempest-ServerRescueNegativeTestJSON-1373728584</nova:project>
Oct 26 06:26:15 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:port uuid="8f0a9975-465e-46c6-a0cf-777bcaf3a2df">
Oct 26 06:26:15 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 06:26:15 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:15 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:15 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:15 user nova-compute[74295]:   </metadata>
Oct 26 06:26:15 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:15 user nova-compute[74295]:     <system>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="serial">b1d6362b-2ffb-4574-8f19-48855f6e7869</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="uuid">b1d6362b-2ffb-4574-8f19-48855f6e7869</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:15 user nova-compute[74295]:     </system>
Oct 26 06:26:15 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:15 user nova-compute[74295]:   <os>
Oct 26 06:26:15 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:15 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:15 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:15 user nova-compute[74295]:   </os>
Oct 26 06:26:15 user nova-compute[74295]:   <features>
Oct 26 06:26:15 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:15 user nova-compute[74295]:     <apic/>
Oct 26 06:26:15 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:15 user nova-compute[74295]:   </features>
Oct 26 06:26:15 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:15 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:15 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:15 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:15 user nova-compute[74295]:   </clock>
Oct 26 06:26:15 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:15 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:15 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:15 user nova-compute[74295]:   </cpu>
Oct 26 06:26:15 user nova-compute[74295]:   <devices>
Oct 26 06:26:15 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:15 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:15 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk"/>
Oct 26 06:26:15 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:26:15 user nova-compute[74295]:     </disk>
Oct 26 06:26:15 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:15 user nova-compute[74295]:       <mac address="fa:16:3e:98:89:6f"/>
Oct 26 06:26:15 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:15 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:15 user nova-compute[74295]:       <target dev="tap8f0a9975-46"/>
Oct 26 06:26:15 user nova-compute[74295]:     </interface>
Oct 26 06:26:15 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:15 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/console.log" append="off"/>
Oct 26 06:26:15 user nova-compute[74295]:     </serial>
Oct 26 06:26:15 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:15 user nova-compute[74295]:     <video>
Oct 26 06:26:15 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:15 user nova-compute[74295]:     </video>
Oct 26 06:26:15 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:15 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:15 user nova-compute[74295]:     </rng>
Oct 26 06:26:15 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:15 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:15 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:15 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:15 user nova-compute[74295]:   </devices>
Oct 26 06:26:15 user nova-compute[74295]: </domain>
Oct 26 06:26:15 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1772937373',display_name='tempest-ServerRescueNegativeTestJSON-server-1772937373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1772937373',id=5,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-a9t47yq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:10Z,user_data=None,user_id='3b0e86cf3ec049a58aee69c427717598',uuid=b1d6362b-2ffb-4574-8f19-48855f6e7869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f0a9975-465e-46c6-a0cf-777bcaf3a2df,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0a9975-46') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG os_vif [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f0a9975-465e-46c6-a0cf-777bcaf3a2df,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0a9975-46') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61ba33f1-0d64-5e36-b6b6-678cfa18d404', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Releasing lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Instance network_info: |[{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-79ce3c33-96e6-44c9-aaa4-0879bdbed47c req-e8c11cc9-cccd-44bd-88ab-865eabd1d73c service nova] Acquired lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-79ce3c33-96e6-44c9-aaa4-0879bdbed47c req-e8c11cc9-cccd-44bd-88ab-865eabd1d73c service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Refreshing network info cache for port fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Start _get_guest_xml network_info=[{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1634403107',display_name='tempest-ServerRescueNegativeTestJSON-server-1634403107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1634403107',id=3,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-rxppw34g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:09Z,user_data=None,user_id='3b0e86cf3ec049a58aee69c427717598',uuid=9f9f523a-896e-414d-a24e-ba2c6b6a9834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:16:4d,bridge_name='br-int',has_traffic_filtering=True,id=fbea3168-b2c6-4ca2-bad1-949003900aa0,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbea3168-b2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.objects.instance [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-6fb2602e-0462-4e24-ae52-4f774c011ee6 req-2f611d03-d38e-4597-b65b-cf5dac32cb92 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-changed-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-6fb2602e-0462-4e24-ae52-4f774c011ee6 req-2f611d03-d38e-4597-b65b-cf5dac32cb92 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Refreshing instance network info cache due to event network-changed-8f0a9975-465e-46c6-a0cf-777bcaf3a2df. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6fb2602e-0462-4e24-ae52-4f774c011ee6 req-2f611d03-d38e-4597-b65b-cf5dac32cb92 service nova] Acquiring lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6fb2602e-0462-4e24-ae52-4f774c011ee6 req-2f611d03-d38e-4597-b65b-cf5dac32cb92 service nova] Acquired lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-6fb2602e-0462-4e24-ae52-4f774c011ee6 req-2f611d03-d38e-4597-b65b-cf5dac32cb92 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Refreshing network info cache for port 8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:15 user nova-compute[74295]:   <uuid>9f9f523a-896e-414d-a24e-ba2c6b6a9834</uuid>
Oct 26 06:26:15 user nova-compute[74295]:   <name>instance-00000003</name>
Oct 26 06:26:15 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:15 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:15 user nova-compute[74295]:   <metadata>
Oct 26 06:26:15 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:15 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1634403107</nova:name>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:15</nova:creationTime>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:15 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:15 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:user uuid="3b0e86cf3ec049a58aee69c427717598">tempest-ServerRescueNegativeTestJSON-1373728584-project-member</nova:user>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:project uuid="65c33a42f4b946d28de9e355927737e8">tempest-ServerRescueNegativeTestJSON-1373728584</nova:project>
Oct 26 06:26:15 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:26:15 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:15 user nova-compute[74295]:         <nova:port uuid="fbea3168-b2c6-4ca2-bad1-949003900aa0">
Oct 26 06:26:15 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 06:26:15 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:15 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:15 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:15 user nova-compute[74295]:   </metadata>
Oct 26 06:26:15 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:15 user nova-compute[74295]:     <system>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="serial">9f9f523a-896e-414d-a24e-ba2c6b6a9834</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="uuid">9f9f523a-896e-414d-a24e-ba2c6b6a9834</entry>
Oct 26 06:26:15 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:15 user nova-compute[74295]:     </system>
Oct 26 06:26:15 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:15 user nova-compute[74295]:   <os>
Oct 26 06:26:15 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:15 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:15 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:15 user nova-compute[74295]:   </os>
Oct 26 06:26:15 user nova-compute[74295]:   <features>
Oct 26 06:26:15 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:15 user nova-compute[74295]:     <apic/>
Oct 26 06:26:15 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:15 user nova-compute[74295]:   </features>
Oct 26 06:26:15 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:15 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:15 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:15 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:15 user nova-compute[74295]:   </clock>
Oct 26 06:26:15 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:15 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:15 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:15 user nova-compute[74295]:   </cpu>
Oct 26 06:26:15 user nova-compute[74295]:   <devices>
Oct 26 06:26:15 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:15 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:15 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk"/>
Oct 26 06:26:15 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:26:15 user nova-compute[74295]:     </disk>
Oct 26 06:26:15 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:15 user nova-compute[74295]:       <mac address="fa:16:3e:5c:16:4d"/>
Oct 26 06:26:15 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:15 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:15 user nova-compute[74295]:       <target dev="tapfbea3168-b2"/>
Oct 26 06:26:15 user nova-compute[74295]:     </interface>
Oct 26 06:26:15 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:15 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/console.log" append="off"/>
Oct 26 06:26:15 user nova-compute[74295]:     </serial>
Oct 26 06:26:15 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:15 user nova-compute[74295]:     <video>
Oct 26 06:26:15 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:15 user nova-compute[74295]:     </video>
Oct 26 06:26:15 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:15 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:15 user nova-compute[74295]:     </rng>
Oct 26 06:26:15 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:15 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:15 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:15 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:15 user nova-compute[74295]:   </devices>
Oct 26 06:26:15 user nova-compute[74295]: </domain>
Oct 26 06:26:15 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1634403107',display_name='tempest-ServerRescueNegativeTestJSON-server-1634403107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1634403107',id=3,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-rxppw34g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:09Z,user_data=None,user_id='3b0e86cf3ec049a58aee69c427717598',uuid=9f9f523a-896e-414d-a24e-ba2c6b6a9834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:16:4d,bridge_name='br-int',has_traffic_filtering=True,id=fbea3168-b2c6-4ca2-bad1-949003900aa0,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbea3168-b2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG os_vif [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:16:4d,bridge_name='br-int',has_traffic_filtering=True,id=fbea3168-b2c6-4ca2-bad1-949003900aa0,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbea3168-b2') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb5bc169-7aee-50c1-a1fc-418467ff0a2d', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85b8870e-a0, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85b8870e-a0, col_values=(('qos', UUID('2975a5e5-2185-4220-a830-38a6f6b3d222')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85b8870e-a0, col_values=(('external_ids', {'iface-id': '85b8870e-a0e3-4389-81c3-ce5277631633', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:99:2c', 'vm-uuid': 'c002695d-145c-4e74-90ae-aa1133680472'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: INFO os_vif [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:2c,bridge_name='br-int',has_traffic_filtering=True,id=85b8870e-a0e3-4389-81c3-ce5277631633,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b8870e-a0')
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88b99f5b-79, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88b99f5b-79, col_values=(('qos', UUID('ef8cf95e-196a-45e6-b3f1-9bf7878bda44')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88b99f5b-79, col_values=(('external_ids', {'iface-id': '88b99f5b-7929-4948-8f2a-48c8d765b554', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:1d:9b', 'vm-uuid': 'c47a4c17-13ba-47af-9979-db4ddfc6dc46'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: INFO os_vif [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:1d:9b,bridge_name='br-int',has_traffic_filtering=True,id=88b99f5b-7929-4948-8f2a-48c8d765b554,network=Network(0999bd3c-3495-4ff8-9d4f-68def80a64be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99f5b-79')
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f0a9975-46, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f0a9975-46, col_values=(('qos', UUID('f0944779-a465-4444-8567-1340afb440c2')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f0a9975-46, col_values=(('external_ids', {'iface-id': '8f0a9975-465e-46c6-a0cf-777bcaf3a2df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:89:6f', 'vm-uuid': 'b1d6362b-2ffb-4574-8f19-48855f6e7869'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: INFO os_vif [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f0a9975-465e-46c6-a0cf-777bcaf3a2df,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0a9975-46')
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbea3168-b2, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbea3168-b2, col_values=(('qos', UUID('e57a8644-b5ce-4636-aebd-26f97e907af0')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbea3168-b2, col_values=(('external_ids', {'iface-id': 'fbea3168-b2c6-4ca2-bad1-949003900aa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:16:4d', 'vm-uuid': '9f9f523a-896e-414d-a24e-ba2c6b6a9834'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No VIF found with MAC fa:16:3e:32:99:2c, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] No VIF found with MAC fa:16:3e:53:1d:9b, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:16 user nova-compute[74295]: INFO os_vif [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:16:4d,bridge_name='br-int',has_traffic_filtering=True,id=fbea3168-b2c6-4ca2-bad1-949003900aa0,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbea3168-b2')
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No VIF found with MAC fa:16:3e:98:89:6f, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-d86199ea-33d6-46a3-9ca6-c514d2e17321 req-52cfd120-501a-472f-bb66-d5db5a226fff service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-changed-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-d86199ea-33d6-46a3-9ca6-c514d2e17321 req-52cfd120-501a-472f-bb66-d5db5a226fff service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Refreshing instance network info cache due to event network-changed-f0e3fe7f-b73a-48b6-bc9d-adac272022b4. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d86199ea-33d6-46a3-9ca6-c514d2e17321 req-52cfd120-501a-472f-bb66-d5db5a226fff service nova] Acquiring lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No VIF found with MAC fa:16:3e:5c:16:4d, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.network.neutron [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Successfully created port: 6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.network.neutron [req-6fb2602e-0462-4e24-ae52-4f774c011ee6 req-2f611d03-d38e-4597-b65b-cf5dac32cb92 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updated VIF entry in instance network info cache for port 8f0a9975-465e-46c6-a0cf-777bcaf3a2df. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.network.neutron [req-6fb2602e-0462-4e24-ae52-4f774c011ee6 req-2f611d03-d38e-4597-b65b-cf5dac32cb92 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updating instance_info_cache with network_info: [{"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6fb2602e-0462-4e24-ae52-4f774c011ee6 req-2f611d03-d38e-4597-b65b-cf5dac32cb92 service nova] Releasing lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance_info_cache with network_info: [{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Releasing lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance network_info: |[{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d86199ea-33d6-46a3-9ca6-c514d2e17321 req-52cfd120-501a-472f-bb66-d5db5a226fff service nova] Acquired lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.network.neutron [req-d86199ea-33d6-46a3-9ca6-c514d2e17321 req-52cfd120-501a-472f-bb66-d5db5a226fff service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Refreshing network info cache for port f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Start _get_guest_xml network_info=[{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:16 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:16 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-97936637',display_name='tempest-ServerActionsTestOtherB-server-97936637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-97936637',id=4,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmm1IaoBoVd8Hkv3gtx/L78lFPzYOW0A2Qqc9FfseOv4MiM64O4tVX1rCM39AF+LH46KHkGVTicvdWviQLc+ppyTXiLGRvBGUpaFnTBwUaROd5zinEiEdd3gXRLbgwTBg==',key_name='tempest-keypair-393220372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd8a2b9f8cce49d4985549fd42dc1e8a',ramdisk_id='',reservation_id='r-cmxn1myp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-406693711',owner_user_name='tempest-ServerActionsTestOtherB-406693711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e44a6886b2b478dbca031edd15a9a6f',uuid=775d5e2e-95a6-4a86-b6f3-ce96735378d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converting VIF {"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lazy-loading 'pci_devices' on Instance uuid 775d5e2e-95a6-4a86-b6f3-ce96735378d9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:16 user nova-compute[74295]:   <uuid>775d5e2e-95a6-4a86-b6f3-ce96735378d9</uuid>
Oct 26 06:26:16 user nova-compute[74295]:   <name>instance-00000004</name>
Oct 26 06:26:16 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:16 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:16 user nova-compute[74295]:   <metadata>
Oct 26 06:26:16 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:16 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:16 user nova-compute[74295]:       <nova:name>tempest-ServerActionsTestOtherB-server-97936637</nova:name>
Oct 26 06:26:16 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:16</nova:creationTime>
Oct 26 06:26:16 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:16 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:16 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:16 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:16 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:16 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:16 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:16 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:16 user nova-compute[74295]:         <nova:user uuid="8e44a6886b2b478dbca031edd15a9a6f">tempest-ServerActionsTestOtherB-406693711-project-member</nova:user>
Oct 26 06:26:16 user nova-compute[74295]:         <nova:project uuid="dd8a2b9f8cce49d4985549fd42dc1e8a">tempest-ServerActionsTestOtherB-406693711</nova:project>
Oct 26 06:26:16 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:16 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:26:16 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:16 user nova-compute[74295]:         <nova:port uuid="f0e3fe7f-b73a-48b6-bc9d-adac272022b4">
Oct 26 06:26:16 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 06:26:16 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:16 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:16 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:16 user nova-compute[74295]:   </metadata>
Oct 26 06:26:16 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:16 user nova-compute[74295]:     <system>
Oct 26 06:26:16 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:16 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:16 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:16 user nova-compute[74295]:       <entry name="serial">775d5e2e-95a6-4a86-b6f3-ce96735378d9</entry>
Oct 26 06:26:16 user nova-compute[74295]:       <entry name="uuid">775d5e2e-95a6-4a86-b6f3-ce96735378d9</entry>
Oct 26 06:26:16 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:16 user nova-compute[74295]:     </system>
Oct 26 06:26:16 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:16 user nova-compute[74295]:   <os>
Oct 26 06:26:16 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:16 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:16 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:16 user nova-compute[74295]:   </os>
Oct 26 06:26:16 user nova-compute[74295]:   <features>
Oct 26 06:26:16 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:16 user nova-compute[74295]:     <apic/>
Oct 26 06:26:16 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:16 user nova-compute[74295]:   </features>
Oct 26 06:26:16 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:16 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:16 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:16 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:16 user nova-compute[74295]:   </clock>
Oct 26 06:26:16 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:16 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:16 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:16 user nova-compute[74295]:   </cpu>
Oct 26 06:26:16 user nova-compute[74295]:   <devices>
Oct 26 06:26:16 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:16 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:16 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk"/>
Oct 26 06:26:16 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:26:16 user nova-compute[74295]:     </disk>
Oct 26 06:26:16 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:16 user nova-compute[74295]:       <mac address="fa:16:3e:ad:4f:d9"/>
Oct 26 06:26:16 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:16 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:16 user nova-compute[74295]:       <target dev="tapf0e3fe7f-b7"/>
Oct 26 06:26:16 user nova-compute[74295]:     </interface>
Oct 26 06:26:16 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:16 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/console.log" append="off"/>
Oct 26 06:26:16 user nova-compute[74295]:     </serial>
Oct 26 06:26:16 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:16 user nova-compute[74295]:     <video>
Oct 26 06:26:16 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:16 user nova-compute[74295]:     </video>
Oct 26 06:26:16 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:16 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:16 user nova-compute[74295]:     </rng>
Oct 26 06:26:16 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:16 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:16 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:16 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:16 user nova-compute[74295]:   </devices>
Oct 26 06:26:16 user nova-compute[74295]: </domain>
Oct 26 06:26:16 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-97936637',display_name='tempest-ServerActionsTestOtherB-server-97936637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-97936637',id=4,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmm1IaoBoVd8Hkv3gtx/L78lFPzYOW0A2Qqc9FfseOv4MiM64O4tVX1rCM39AF+LH46KHkGVTicvdWviQLc+ppyTXiLGRvBGUpaFnTBwUaROd5zinEiEdd3gXRLbgwTBg==',key_name='tempest-keypair-393220372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd8a2b9f8cce49d4985549fd42dc1e8a',ramdisk_id='',reservation_id='r-cmxn1myp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-406693711',owner_user_name='tempest-ServerActionsTestOtherB-406693711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e44a6886b2b478dbca031edd15a9a6f',uuid=775d5e2e-95a6-4a86-b6f3-ce96735378d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converting VIF {"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG os_vif [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09c8a9b3-4d0d-53c7-b32d-edd04837daa9', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0e3fe7f-b7, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0e3fe7f-b7, col_values=(('qos', UUID('1205f2da-414a-47fe-8bf3-3165ca62555c')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0e3fe7f-b7, col_values=(('external_ids', {'iface-id': 'f0e3fe7f-b73a-48b6-bc9d-adac272022b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:4f:d9', 'vm-uuid': '775d5e2e-95a6-4a86-b6f3-ce96735378d9'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:16 user nova-compute[74295]: INFO os_vif [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7')
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] No VIF found with MAC fa:16:3e:ad:4f:d9, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG nova.network.neutron [req-79ce3c33-96e6-44c9-aaa4-0879bdbed47c req-e8c11cc9-cccd-44bd-88ab-865eabd1d73c service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updated VIF entry in instance network info cache for port fbea3168-b2c6-4ca2-bad1-949003900aa0. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG nova.network.neutron [req-79ce3c33-96e6-44c9-aaa4-0879bdbed47c req-e8c11cc9-cccd-44bd-88ab-865eabd1d73c service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updating instance_info_cache with network_info: [{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-79ce3c33-96e6-44c9-aaa4-0879bdbed47c req-e8c11cc9-cccd-44bd-88ab-865eabd1d73c service nova] Releasing lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG nova.network.neutron [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Successfully updated port: 6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquired lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG nova.network.neutron [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-55c7fed4-59c6-4248-bbea-07dab18c92a3 req-c03ad80f-0e51-4a38-b36e-ec79dbbe36a7 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received event network-changed-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-55c7fed4-59c6-4248-bbea-07dab18c92a3 req-c03ad80f-0e51-4a38-b36e-ec79dbbe36a7 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Refreshing instance network info cache due to event network-changed-6f426b1f-4f0b-43d7-aea7-6a6c3e130773. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-55c7fed4-59c6-4248-bbea-07dab18c92a3 req-c03ad80f-0e51-4a38-b36e-ec79dbbe36a7 service nova] Acquiring lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:17 user nova-compute[74295]: DEBUG nova.network.neutron [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG nova.network.neutron [req-d86199ea-33d6-46a3-9ca6-c514d2e17321 req-52cfd120-501a-472f-bb66-d5db5a226fff service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updated VIF entry in instance network info cache for port f0e3fe7f-b73a-48b6-bc9d-adac272022b4. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG nova.network.neutron [req-d86199ea-33d6-46a3-9ca6-c514d2e17321 req-52cfd120-501a-472f-bb66-d5db5a226fff service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance_info_cache with network_info: [{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d86199ea-33d6-46a3-9ca6-c514d2e17321 req-52cfd120-501a-472f-bb66-d5db5a226fff service nova] Releasing lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG nova.network.neutron [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updating instance_info_cache with network_info: [{"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Releasing lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Instance network_info: |[{"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-55c7fed4-59c6-4248-bbea-07dab18c92a3 req-c03ad80f-0e51-4a38-b36e-ec79dbbe36a7 service nova] Acquired lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG nova.network.neutron [req-55c7fed4-59c6-4248-bbea-07dab18c92a3 req-c03ad80f-0e51-4a38-b36e-ec79dbbe36a7 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Refreshing network info cache for port 6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:18 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Start _get_guest_xml network_info=[{"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:19 user nova-compute[74295]: DEBUG nova.network.neutron [req-55c7fed4-59c6-4248-bbea-07dab18c92a3 req-c03ad80f-0e51-4a38-b36e-ec79dbbe36a7 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updated VIF entry in instance network info cache for port 6f426b1f-4f0b-43d7-aea7-6a6c3e130773. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:19 user nova-compute[74295]: DEBUG nova.network.neutron [req-55c7fed4-59c6-4248-bbea-07dab18c92a3 req-c03ad80f-0e51-4a38-b36e-ec79dbbe36a7 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updating instance_info_cache with network_info: [{"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-55c7fed4-59c6-4248-bbea-07dab18c92a3 req-c03ad80f-0e51-4a38-b36e-ec79dbbe36a7 service nova] Releasing lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:26:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Instance spawned successfully.
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:26:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Instance spawned successfully.
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:26:25 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:25 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1740260226',display_name='tempest-ServerActionsTestOtherA-server-1740260226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1740260226',id=6,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEalUstBq4vFH7qnNchfBeKikF9/lcUlFw9j5QYSoSoqdNDpcgRH/nIAEmyjwdsmFPjVTLPazAWFfDhK1wvnJyZTilappqjUYF52/w6x/BiOg104d9g3zNtJX38DMWLdw==',key_name='tempest-keypair-977042820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-8axglv5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=4258d8a5-3e8b-4a4d-8ca6-420ece04e598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e7:bf,bridge_name='br-int',has_traffic_filtering=True,id=6f426b1f-4f0b-43d7-aea7-6a6c3e130773,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f426b1f-4f') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.objects.instance [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'pci_devices' on Instance uuid 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:25 user nova-compute[74295]:   <uuid>4258d8a5-3e8b-4a4d-8ca6-420ece04e598</uuid>
Oct 26 06:26:25 user nova-compute[74295]:   <name>instance-00000006</name>
Oct 26 06:26:25 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:25 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:25 user nova-compute[74295]:   <metadata>
Oct 26 06:26:25 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:25 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:25 user nova-compute[74295]:       <nova:name>tempest-ServerActionsTestOtherA-server-1740260226</nova:name>
Oct 26 06:26:25 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:25</nova:creationTime>
Oct 26 06:26:25 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:25 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:25 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:25 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:25 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:25 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:25 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:25 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:25 user nova-compute[74295]:         <nova:user uuid="e3c3d6fa25d143bc935e7e16275aac57">tempest-ServerActionsTestOtherA-911482981-project-member</nova:user>
Oct 26 06:26:25 user nova-compute[74295]:         <nova:project uuid="83b6035868e347c4b90651f3ad73237a">tempest-ServerActionsTestOtherA-911482981</nova:project>
Oct 26 06:26:25 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:25 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:26:25 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:25 user nova-compute[74295]:         <nova:port uuid="6f426b1f-4f0b-43d7-aea7-6a6c3e130773">
Oct 26 06:26:25 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 06:26:25 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:25 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:25 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:25 user nova-compute[74295]:   </metadata>
Oct 26 06:26:25 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:25 user nova-compute[74295]:     <system>
Oct 26 06:26:25 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:25 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:25 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:25 user nova-compute[74295]:       <entry name="serial">4258d8a5-3e8b-4a4d-8ca6-420ece04e598</entry>
Oct 26 06:26:25 user nova-compute[74295]:       <entry name="uuid">4258d8a5-3e8b-4a4d-8ca6-420ece04e598</entry>
Oct 26 06:26:25 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:25 user nova-compute[74295]:     </system>
Oct 26 06:26:25 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:25 user nova-compute[74295]:   <os>
Oct 26 06:26:25 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:25 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:25 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:25 user nova-compute[74295]:   </os>
Oct 26 06:26:25 user nova-compute[74295]:   <features>
Oct 26 06:26:25 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:25 user nova-compute[74295]:     <apic/>
Oct 26 06:26:25 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:25 user nova-compute[74295]:   </features>
Oct 26 06:26:25 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:25 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:25 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:25 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:25 user nova-compute[74295]:   </clock>
Oct 26 06:26:25 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:25 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:25 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:25 user nova-compute[74295]:   </cpu>
Oct 26 06:26:25 user nova-compute[74295]:   <devices>
Oct 26 06:26:25 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:25 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:25 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk"/>
Oct 26 06:26:25 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:26:25 user nova-compute[74295]:     </disk>
Oct 26 06:26:25 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:25 user nova-compute[74295]:       <mac address="fa:16:3e:e0:e7:bf"/>
Oct 26 06:26:25 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:25 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:25 user nova-compute[74295]:       <target dev="tap6f426b1f-4f"/>
Oct 26 06:26:25 user nova-compute[74295]:     </interface>
Oct 26 06:26:25 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:25 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/console.log" append="off"/>
Oct 26 06:26:25 user nova-compute[74295]:     </serial>
Oct 26 06:26:25 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:25 user nova-compute[74295]:     <video>
Oct 26 06:26:25 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:25 user nova-compute[74295]:     </video>
Oct 26 06:26:25 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:25 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:25 user nova-compute[74295]:     </rng>
Oct 26 06:26:25 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:25 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:25 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:25 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:25 user nova-compute[74295]:   </devices>
Oct 26 06:26:25 user nova-compute[74295]: </domain>
Oct 26 06:26:25 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1740260226',display_name='tempest-ServerActionsTestOtherA-server-1740260226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1740260226',id=6,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEalUstBq4vFH7qnNchfBeKikF9/lcUlFw9j5QYSoSoqdNDpcgRH/nIAEmyjwdsmFPjVTLPazAWFfDhK1wvnJyZTilappqjUYF52/w6x/BiOg104d9g3zNtJX38DMWLdw==',key_name='tempest-keypair-977042820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-8axglv5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=4258d8a5-3e8b-4a4d-8ca6-420ece04e598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e7:bf,bridge_name='br-int',has_traffic_filtering=True,id=6f426b1f-4f0b-43d7-aea7-6a6c3e130773,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f426b1f-4f') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG os_vif [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e7:bf,bridge_name='br-int',has_traffic_filtering=True,id=6f426b1f-4f0b-43d7-aea7-6a6c3e130773,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f426b1f-4f') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eac6dd56-cce8-55c5-b558-b07665a76b70', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:25 user nova-compute[74295]: INFO nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Took 16.15 seconds to spawn the instance on the hypervisor.
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:26:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Instance spawned successfully.
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:26:25 user nova-compute[74295]: INFO nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Took 18.76 seconds to spawn the instance on the hypervisor.
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f426b1f-4f, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f426b1f-4f, col_values=(('qos', UUID('3d87c9e0-cfa9-447a-af44-99ffd1c4ebf6')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f426b1f-4f, col_values=(('external_ids', {'iface-id': '6f426b1f-4f0b-43d7-aea7-6a6c3e130773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:e7:bf', 'vm-uuid': '4258d8a5-3e8b-4a4d-8ca6-420ece04e598'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance spawned successfully.
Oct 26 06:26:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:26 user nova-compute[74295]: INFO os_vif [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e7:bf,bridge_name='br-int',has_traffic_filtering=True,id=6f426b1f-4f0b-43d7-aea7-6a6c3e130773,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f426b1f-4f')
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:26 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c002695d-145c-4e74-90ae-aa1133680472] Instance spawned successfully.
Oct 26 06:26:26 user nova-compute[74295]: INFO nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Took 17.26 seconds to spawn the instance on the hypervisor.
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:26:26 user nova-compute[74295]: INFO nova.compute.manager [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Took 20.11 seconds to build instance.
Oct 26 06:26:26 user nova-compute[74295]: INFO nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Took 16.93 seconds to spawn the instance on the hypervisor.
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b3867dc5-dce2-454a-acce-8220bfed008a tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.334s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:26 user nova-compute[74295]: INFO nova.compute.manager [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Took 17.89 seconds to build instance.
Oct 26 06:26:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e70fa009-7b08-4e74-8a8c-8ac3af1eed2f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.056s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No VIF found with MAC fa:16:3e:e0:e7:bf, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:26 user nova-compute[74295]: INFO nova.compute.manager [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Took 18.56 seconds to build instance.
Oct 26 06:26:26 user nova-compute[74295]: INFO nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Took 18.62 seconds to spawn the instance on the hypervisor.
Oct 26 06:26:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fbf04741-7f7a-44ad-af83-a796f8c73aa9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.791s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:26 user nova-compute[74295]: INFO nova.compute.manager [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Took 18.61 seconds to build instance.
Oct 26 06:26:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b1d43e46-e6e3-4189-b0eb-b4454837d97a tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.810s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:26 user nova-compute[74295]: INFO nova.compute.manager [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Took 20.27 seconds to build instance.
Oct 26 06:26:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6764c610-d0b0-40ce-97f7-4779841d31ba tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "c002695d-145c-4e74-90ae-aa1133680472" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.409s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.030s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:28 user nova-compute[74295]: INFO nova.compute.claims [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Claim successful on node user
Oct 26 06:26:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:28 user nova-compute[74295]: DEBUG nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.229s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.575s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:29 user nova-compute[74295]: INFO nova.compute.claims [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Claim successful on node user
Oct 26 06:26:29 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:29 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:29 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:29 user nova-compute[74295]: DEBUG nova.policy [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46038c5dea054670abdc18796ab34513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbabe75d3ef74e7392fdb286d76a0c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:30 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Creating image(s)
Oct 26 06:26:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "/opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "/opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "/opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "3e9ad31671f8ab22d035f33072814d0241e0dd83" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "3e9ad31671f8ab22d035f33072814d0241e0dd83" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Successfully created port: f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83.part --force-share --output=json" returned: 0 in 0.248s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.images [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] 2e535bcc-c838-4318-a22f-4ce6935ae7ff was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83.part /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.609s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.network.neutron [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:31 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83.part /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83.converted" returned: 0 in 0.273s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.policy [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4691863b37da4920a7d50434b9f4584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14561432954b4ce78599f0bd131a1863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:31 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Creating image(s)
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "/opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "/opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "/opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83.converted --force-share --output=json" returned: 0 in 0.453s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "3e9ad31671f8ab22d035f33072814d0241e0dd83" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.715s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:26:31 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Instance spawned successfully.
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:32 user nova-compute[74295]: INFO nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Took 18.78 seconds to spawn the instance on the hypervisor.
Oct 26 06:26:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.359s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83 --force-share --output=json" returned: 0 in 0.341s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "3e9ad31671f8ab22d035f33072814d0241e0dd83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "3e9ad31671f8ab22d035f33072814d0241e0dd83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:32 user nova-compute[74295]: INFO nova.compute.manager [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Took 19.73 seconds to build instance.
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-38d6fa78-215d-4076-98ed-cbc2e6b7c311 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.908s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.438s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83 --force-share --output=json" returned: 0 in 0.497s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83,backing_fmt=raw /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk 1073741824" returned: 0 in 0.151s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.602s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83,backing_fmt=raw /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk 1073741824" returned: 0 in 0.103s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "3e9ad31671f8ab22d035f33072814d0241e0dd83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.611s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Successfully updated port: f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "refresh_cache-46e224d1-67ea-4449-8952-4554bb302d98" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquired lock "refresh_cache-46e224d1-67ea-4449-8952-4554bb302d98" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:32 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-6ccbbd63-b119-4734-87ce-a3644d4233e3 req-17a6d5c8-65f6-4d90-b98e-5ce28d7f2dbb service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received event network-changed-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-6ccbbd63-b119-4734-87ce-a3644d4233e3 req-17a6d5c8-65f6-4d90-b98e-5ce28d7f2dbb service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Refreshing instance network info cache due to event network-changed-f90efd59-670f-4d95-9434-a9cbaf114f1d. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6ccbbd63-b119-4734-87ce-a3644d4233e3 req-17a6d5c8-65f6-4d90-b98e-5ce28d7f2dbb service nova] Acquiring lock "refresh_cache-46e224d1-67ea-4449-8952-4554bb302d98" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.453s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83 --force-share --output=json" returned: 0 in 0.473s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.455s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Cannot resize image /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Ensure instance console log exists: /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json" returned: 0 in 0.456s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Cannot resize image /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Ensure instance console log exists: /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Successfully created port: 860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Updating instance_info_cache with network_info: [{"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Releasing lock "refresh_cache-46e224d1-67ea-4449-8952-4554bb302d98" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Instance network_info: |[{"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6ccbbd63-b119-4734-87ce-a3644d4233e3 req-17a6d5c8-65f6-4d90-b98e-5ce28d7f2dbb service nova] Acquired lock "refresh_cache-46e224d1-67ea-4449-8952-4554bb302d98" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-6ccbbd63-b119-4734-87ce-a3644d4233e3 req-17a6d5c8-65f6-4d90-b98e-5ce28d7f2dbb service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Refreshing network info cache for port f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Start _get_guest_xml network_info=[{"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:26:20Z,direct_url=<?>,disk_format='qcow2',id=2e535bcc-c838-4318-a22f-4ce6935ae7ff,min_disk=0,min_ram=0,name='',owner='0b8fc6cb9ef7446fab2d9a5ac3bc0f16',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:26:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'scsi', 'encryption_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '2e535bcc-c838-4318-a22f-4ce6935ae7ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:34 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:34 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:26:20Z,direct_url=<?>,disk_format='qcow2',id=2e535bcc-c838-4318-a22f-4ce6935ae7ff,min_disk=0,min_ram=0,name='',owner='0b8fc6cb9ef7446fab2d9a5ac3bc0f16',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:26:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-435418608',display_name='tempest-AttachSCSIVolumeTestJSON-server-435418608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-435418608',id=7,image_ref='2e535bcc-c838-4318-a22f-4ce6935ae7ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5P5cH9C1MwdPpbHO2TImsXeJFnRWY2M8HQLmKDjuSvCAXf4zdE4WTAegP++VWU8i7Bs5+eidcU9EH4KKjPTEag4PhLiSlPTwuOGur9RZpQUKbXK/n+J8XjtlLdIs7ylg==',key_name='tempest-keypair-720622320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbabe75d3ef74e7392fdb286d76a0c5b',ramdisk_id='',reservation_id='r-q14f8qem',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2e535bcc-c838-4318-a22f-4ce6935ae7ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-309639301',owner_user_name='tempest-AttachSCSIVolumeTestJSON-309639301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46038c5dea054670abdc18796ab34513',uuid=46e224d1-67ea-4449-8952-4554bb302d98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Converting VIF {"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e0:25,bridge_name='br-int',has_traffic_filtering=True,id=f90efd59-670f-4d95-9434-a9cbaf114f1d,network=Network(0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90efd59-67') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lazy-loading 'pci_devices' on Instance uuid 46e224d1-67ea-4449-8952-4554bb302d98 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:34 user nova-compute[74295]:   <uuid>46e224d1-67ea-4449-8952-4554bb302d98</uuid>
Oct 26 06:26:34 user nova-compute[74295]:   <name>instance-00000007</name>
Oct 26 06:26:34 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:34 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:34 user nova-compute[74295]:   <metadata>
Oct 26 06:26:34 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:34 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:34 user nova-compute[74295]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-435418608</nova:name>
Oct 26 06:26:34 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:34</nova:creationTime>
Oct 26 06:26:34 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:34 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:34 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:34 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:34 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:34 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:34 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:34 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:34 user nova-compute[74295]:         <nova:user uuid="46038c5dea054670abdc18796ab34513">tempest-AttachSCSIVolumeTestJSON-309639301-project-member</nova:user>
Oct 26 06:26:34 user nova-compute[74295]:         <nova:project uuid="bbabe75d3ef74e7392fdb286d76a0c5b">tempest-AttachSCSIVolumeTestJSON-309639301</nova:project>
Oct 26 06:26:34 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:34 user nova-compute[74295]:       <nova:root type="image" uuid="2e535bcc-c838-4318-a22f-4ce6935ae7ff"/>
Oct 26 06:26:34 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:34 user nova-compute[74295]:         <nova:port uuid="f90efd59-670f-4d95-9434-a9cbaf114f1d">
Oct 26 06:26:34 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 06:26:34 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:34 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:34 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:34 user nova-compute[74295]:   </metadata>
Oct 26 06:26:34 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:34 user nova-compute[74295]:     <system>
Oct 26 06:26:34 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:34 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:34 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:34 user nova-compute[74295]:       <entry name="serial">46e224d1-67ea-4449-8952-4554bb302d98</entry>
Oct 26 06:26:34 user nova-compute[74295]:       <entry name="uuid">46e224d1-67ea-4449-8952-4554bb302d98</entry>
Oct 26 06:26:34 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:34 user nova-compute[74295]:     </system>
Oct 26 06:26:34 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:34 user nova-compute[74295]:   <os>
Oct 26 06:26:34 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:34 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:34 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:34 user nova-compute[74295]:   </os>
Oct 26 06:26:34 user nova-compute[74295]:   <features>
Oct 26 06:26:34 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:34 user nova-compute[74295]:     <apic/>
Oct 26 06:26:34 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:34 user nova-compute[74295]:   </features>
Oct 26 06:26:34 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:34 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:34 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:34 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:34 user nova-compute[74295]:   </clock>
Oct 26 06:26:34 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:34 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:34 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:34 user nova-compute[74295]:   </cpu>
Oct 26 06:26:34 user nova-compute[74295]:   <devices>
Oct 26 06:26:34 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:34 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:34 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk"/>
Oct 26 06:26:34 user nova-compute[74295]:       <target dev="sda" bus="scsi"/>
Oct 26 06:26:34 user nova-compute[74295]:       <address type="drive" controller="0" unit="0"/>
Oct 26 06:26:34 user nova-compute[74295]:     </disk>
Oct 26 06:26:34 user nova-compute[74295]:     <disk type="file" device="cdrom">
Oct 26 06:26:34 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 06:26:34 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk.config"/>
Oct 26 06:26:34 user nova-compute[74295]:       <target dev="sdb" bus="scsi"/>
Oct 26 06:26:34 user nova-compute[74295]:       <address type="drive" controller="0" unit="1"/>
Oct 26 06:26:34 user nova-compute[74295]:     </disk>
Oct 26 06:26:34 user nova-compute[74295]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 26 06:26:34 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:34 user nova-compute[74295]:       <mac address="fa:16:3e:bb:e0:25"/>
Oct 26 06:26:34 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:34 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:34 user nova-compute[74295]:       <target dev="tapf90efd59-67"/>
Oct 26 06:26:34 user nova-compute[74295]:     </interface>
Oct 26 06:26:34 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:34 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/console.log" append="off"/>
Oct 26 06:26:34 user nova-compute[74295]:     </serial>
Oct 26 06:26:34 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:34 user nova-compute[74295]:     <video>
Oct 26 06:26:34 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:34 user nova-compute[74295]:     </video>
Oct 26 06:26:34 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:34 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:34 user nova-compute[74295]:     </rng>
Oct 26 06:26:34 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:34 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:34 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:34 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:34 user nova-compute[74295]:   </devices>
Oct 26 06:26:34 user nova-compute[74295]: </domain>
Oct 26 06:26:34 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-435418608',display_name='tempest-AttachSCSIVolumeTestJSON-server-435418608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-435418608',id=7,image_ref='2e535bcc-c838-4318-a22f-4ce6935ae7ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5P5cH9C1MwdPpbHO2TImsXeJFnRWY2M8HQLmKDjuSvCAXf4zdE4WTAegP++VWU8i7Bs5+eidcU9EH4KKjPTEag4PhLiSlPTwuOGur9RZpQUKbXK/n+J8XjtlLdIs7ylg==',key_name='tempest-keypair-720622320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbabe75d3ef74e7392fdb286d76a0c5b',ramdisk_id='',reservation_id='r-q14f8qem',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2e535bcc-c838-4318-a22f-4ce6935ae7ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-309639301',owner_user_name='tempest-AttachSCSIVolumeTestJSON-309639301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46038c5dea054670abdc18796ab34513',uuid=46e224d1-67ea-4449-8952-4554bb302d98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Converting VIF {"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e0:25,bridge_name='br-int',has_traffic_filtering=True,id=f90efd59-670f-4d95-9434-a9cbaf114f1d,network=Network(0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90efd59-67') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG os_vif [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e0:25,bridge_name='br-int',has_traffic_filtering=True,id=f90efd59-670f-4d95-9434-a9cbaf114f1d,network=Network(0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90efd59-67') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a65a0eb2-1fad-56d3-9f82-c44d712d0ceb', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf90efd59-67, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf90efd59-67, col_values=(('qos', UUID('a0040a38-0031-4c2b-b781-95db9e71e011')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf90efd59-67, col_values=(('external_ids', {'iface-id': 'f90efd59-670f-4d95-9434-a9cbaf114f1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:e0:25', 'vm-uuid': '46e224d1-67ea-4449-8952-4554bb302d98'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:34 user nova-compute[74295]: INFO os_vif [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e0:25,bridge_name='br-int',has_traffic_filtering=True,id=f90efd59-670f-4d95-9434-a9cbaf114f1d,network=Network(0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90efd59-67')
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Successfully updated port: 860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] No BDM found with device name sda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] No VIF found with MAC fa:16:3e:bb:e0:25, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Using config drive
Oct 26 06:26:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "refresh_cache-88335730-9d04-4614-8c24-f0c3957418f2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquired lock "refresh_cache-88335730-9d04-4614-8c24-f0c3957418f2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-475920c1-ca9c-4c12-9b23-f8c8ae44adb7 req-f2b5186f-bca2-49e3-877a-8dc8e22f60f4 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received event network-changed-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-475920c1-ca9c-4c12-9b23-f8c8ae44adb7 req-f2b5186f-bca2-49e3-877a-8dc8e22f60f4 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Refreshing instance network info cache due to event network-changed-860eca16-317b-46e1-aa65-716d66e7b7ca. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-475920c1-ca9c-4c12-9b23-f8c8ae44adb7 req-f2b5186f-bca2-49e3-877a-8dc8e22f60f4 service nova] Acquiring lock "refresh_cache-88335730-9d04-4614-8c24-f0c3957418f2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:35 user nova-compute[74295]: DEBUG nova.network.neutron [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:35 user nova-compute[74295]: DEBUG nova.network.neutron [req-6ccbbd63-b119-4734-87ce-a3644d4233e3 req-17a6d5c8-65f6-4d90-b98e-5ce28d7f2dbb service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Updated VIF entry in instance network info cache for port f90efd59-670f-4d95-9434-a9cbaf114f1d. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:35 user nova-compute[74295]: DEBUG nova.network.neutron [req-6ccbbd63-b119-4734-87ce-a3644d4233e3 req-17a6d5c8-65f6-4d90-b98e-5ce28d7f2dbb service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Updating instance_info_cache with network_info: [{"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6ccbbd63-b119-4734-87ce-a3644d4233e3 req-17a6d5c8-65f6-4d90-b98e-5ce28d7f2dbb service nova] Releasing lock "refresh_cache-46e224d1-67ea-4449-8952-4554bb302d98" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:36 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Creating config drive at /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk.config
Oct 26 06:26:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps5isi5sb {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps5isi5sb" returned: 0 in 0.065s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.network.neutron [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Updating instance_info_cache with network_info: [{"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Releasing lock "refresh_cache-88335730-9d04-4614-8c24-f0c3957418f2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Instance network_info: |[{"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-475920c1-ca9c-4c12-9b23-f8c8ae44adb7 req-f2b5186f-bca2-49e3-877a-8dc8e22f60f4 service nova] Acquired lock "refresh_cache-88335730-9d04-4614-8c24-f0c3957418f2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.network.neutron [req-475920c1-ca9c-4c12-9b23-f8c8ae44adb7 req-f2b5186f-bca2-49e3-877a-8dc8e22f60f4 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Refreshing network info cache for port 860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Start _get_guest_xml network_info=[{"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:36 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:36 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1178213190',display_name='tempest-VolumesAdminNegativeTest-server-1178213190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1178213190',id=8,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDigW1iO7v8D/3Y78VhHUPq4WOhWQBt5JTPhjsnwB8miq8nWuxh/eaxy6tWPoS92DhVjAVpbaWJrBFUYNUCjtvVmShsMij7YX6gknbT0bdGnHHPsWw8iqDQVkXxJJhKE7Q==',key_name='tempest-keypair-1217667034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14561432954b4ce78599f0bd131a1863',ramdisk_id='',reservation_id='r-nml640zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-417079322',owner_user_name='tempest-VolumesAdminNegativeTest-417079322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4691863b37da4920a7d50434b9f4584c',uuid=88335730-9d04-4614-8c24-f0c3957418f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converting VIF {"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ae:bc,bridge_name='br-int',has_traffic_filtering=True,id=860eca16-317b-46e1-aa65-716d66e7b7ca,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860eca16-31') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.objects.instance [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lazy-loading 'pci_devices' on Instance uuid 88335730-9d04-4614-8c24-f0c3957418f2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:36 user nova-compute[74295]:   <uuid>88335730-9d04-4614-8c24-f0c3957418f2</uuid>
Oct 26 06:26:36 user nova-compute[74295]:   <name>instance-00000008</name>
Oct 26 06:26:36 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:36 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:36 user nova-compute[74295]:   <metadata>
Oct 26 06:26:36 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:36 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:36 user nova-compute[74295]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1178213190</nova:name>
Oct 26 06:26:36 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:36</nova:creationTime>
Oct 26 06:26:36 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:36 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:36 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:36 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:36 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:36 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:36 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:36 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:36 user nova-compute[74295]:         <nova:user uuid="4691863b37da4920a7d50434b9f4584c">tempest-VolumesAdminNegativeTest-417079322-project-member</nova:user>
Oct 26 06:26:36 user nova-compute[74295]:         <nova:project uuid="14561432954b4ce78599f0bd131a1863">tempest-VolumesAdminNegativeTest-417079322</nova:project>
Oct 26 06:26:36 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:36 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:26:36 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:36 user nova-compute[74295]:         <nova:port uuid="860eca16-317b-46e1-aa65-716d66e7b7ca">
Oct 26 06:26:36 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 06:26:36 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:36 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:36 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:36 user nova-compute[74295]:   </metadata>
Oct 26 06:26:36 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:36 user nova-compute[74295]:     <system>
Oct 26 06:26:36 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:36 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:36 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:36 user nova-compute[74295]:       <entry name="serial">88335730-9d04-4614-8c24-f0c3957418f2</entry>
Oct 26 06:26:36 user nova-compute[74295]:       <entry name="uuid">88335730-9d04-4614-8c24-f0c3957418f2</entry>
Oct 26 06:26:36 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:36 user nova-compute[74295]:     </system>
Oct 26 06:26:36 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:36 user nova-compute[74295]:   <os>
Oct 26 06:26:36 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:36 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:36 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:36 user nova-compute[74295]:   </os>
Oct 26 06:26:36 user nova-compute[74295]:   <features>
Oct 26 06:26:36 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:36 user nova-compute[74295]:     <apic/>
Oct 26 06:26:36 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:36 user nova-compute[74295]:   </features>
Oct 26 06:26:36 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:36 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:36 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:36 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:36 user nova-compute[74295]:   </clock>
Oct 26 06:26:36 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:36 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:36 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:36 user nova-compute[74295]:   </cpu>
Oct 26 06:26:36 user nova-compute[74295]:   <devices>
Oct 26 06:26:36 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:36 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:36 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk"/>
Oct 26 06:26:36 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:26:36 user nova-compute[74295]:     </disk>
Oct 26 06:26:36 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:36 user nova-compute[74295]:       <mac address="fa:16:3e:f0:ae:bc"/>
Oct 26 06:26:36 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:36 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:36 user nova-compute[74295]:       <target dev="tap860eca16-31"/>
Oct 26 06:26:36 user nova-compute[74295]:     </interface>
Oct 26 06:26:36 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:36 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/console.log" append="off"/>
Oct 26 06:26:36 user nova-compute[74295]:     </serial>
Oct 26 06:26:36 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:36 user nova-compute[74295]:     <video>
Oct 26 06:26:36 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:36 user nova-compute[74295]:     </video>
Oct 26 06:26:36 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:36 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:36 user nova-compute[74295]:     </rng>
Oct 26 06:26:36 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:36 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:36 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:36 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:36 user nova-compute[74295]:   </devices>
Oct 26 06:26:36 user nova-compute[74295]: </domain>
Oct 26 06:26:36 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1178213190',display_name='tempest-VolumesAdminNegativeTest-server-1178213190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1178213190',id=8,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDigW1iO7v8D/3Y78VhHUPq4WOhWQBt5JTPhjsnwB8miq8nWuxh/eaxy6tWPoS92DhVjAVpbaWJrBFUYNUCjtvVmShsMij7YX6gknbT0bdGnHHPsWw8iqDQVkXxJJhKE7Q==',key_name='tempest-keypair-1217667034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14561432954b4ce78599f0bd131a1863',ramdisk_id='',reservation_id='r-nml640zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-417079322',owner_user_name='tempest-VolumesAdminNegativeTest-417079322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4691863b37da4920a7d50434b9f4584c',uuid=88335730-9d04-4614-8c24-f0c3957418f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converting VIF {"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ae:bc,bridge_name='br-int',has_traffic_filtering=True,id=860eca16-317b-46e1-aa65-716d66e7b7ca,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860eca16-31') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG os_vif [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ae:bc,bridge_name='br-int',has_traffic_filtering=True,id=860eca16-317b-46e1-aa65-716d66e7b7ca,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860eca16-31') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '143a369d-a733-5be3-8eb1-9213a5b63afe', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap860eca16-31, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap860eca16-31, col_values=(('qos', UUID('503f45a0-ad3b-491d-968f-413bc26444c7')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap860eca16-31, col_values=(('external_ids', {'iface-id': '860eca16-317b-46e1-aa65-716d66e7b7ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:ae:bc', 'vm-uuid': '88335730-9d04-4614-8c24-f0c3957418f2'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:36 user nova-compute[74295]: INFO os_vif [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:ae:bc,bridge_name='br-int',has_traffic_filtering=True,id=860eca16-317b-46e1-aa65-716d66e7b7ca,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860eca16-31')
Oct 26 06:26:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] No VIF found with MAC fa:16:3e:f0:ae:bc, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:37 user nova-compute[74295]: WARNING nova.compute.manager [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state active and task_state None.
Oct 26 06:26:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:37 user nova-compute[74295]: WARNING nova.compute.manager [req-53690086-cd12-4957-b2fa-b59445ae2d3c req-878480e5-23ac-44e3-8bca-436e0af0b124 service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state active and task_state None.
Oct 26 06:26:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-ad756246-6d90-4921-a991-dae2f6be5497 req-bce08c65-acd5-4daa-9b33-5b53325b5446 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ad756246-6d90-4921-a991-dae2f6be5497 req-bce08c65-acd5-4daa-9b33-5b53325b5446 service nova] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ad756246-6d90-4921-a991-dae2f6be5497 req-bce08c65-acd5-4daa-9b33-5b53325b5446 service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ad756246-6d90-4921-a991-dae2f6be5497 req-bce08c65-acd5-4daa-9b33-5b53325b5446 service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-ad756246-6d90-4921-a991-dae2f6be5497 req-bce08c65-acd5-4daa-9b33-5b53325b5446 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] No waiting events found dispatching network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:38 user nova-compute[74295]: WARNING nova.compute.manager [req-ad756246-6d90-4921-a991-dae2f6be5497 req-bce08c65-acd5-4daa-9b33-5b53325b5446 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received unexpected event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 for instance with vm_state active and task_state None.
Oct 26 06:26:38 user nova-compute[74295]: DEBUG nova.network.neutron [req-475920c1-ca9c-4c12-9b23-f8c8ae44adb7 req-f2b5186f-bca2-49e3-877a-8dc8e22f60f4 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Updated VIF entry in instance network info cache for port 860eca16-317b-46e1-aa65-716d66e7b7ca. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG nova.network.neutron [req-475920c1-ca9c-4c12-9b23-f8c8ae44adb7 req-f2b5186f-bca2-49e3-877a-8dc8e22f60f4 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Updating instance_info_cache with network_info: [{"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-475920c1-ca9c-4c12-9b23-f8c8ae44adb7 req-f2b5186f-bca2-49e3-877a-8dc8e22f60f4 service nova] Releasing lock "refresh_cache-88335730-9d04-4614-8c24-f0c3957418f2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:40 user nova-compute[74295]: INFO nova.compute.claims [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Claim successful on node user
Oct 26 06:26:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] No waiting events found dispatching network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:40 user nova-compute[74295]: WARNING nova.compute.manager [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received unexpected event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 for instance with vm_state active and task_state None.
Oct 26 06:26:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:40 user nova-compute[74295]: WARNING nova.compute.manager [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state active and task_state None.
Oct 26 06:26:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:40 user nova-compute[74295]: WARNING nova.compute.manager [req-451db6af-6e4a-4428-baaf-8e733487794a req-279f5e98-a321-4482-9512-cb86c784fddf service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state active and task_state None.
Oct 26 06:26:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:40 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.866s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG nova.network.neutron [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:41 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG nova.policy [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '620a58893e6f41a1ae1e57f672427d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5684b5893b604af484029883dbf5132b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:41 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Creating image(s)
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.237s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk 1073741824" returned: 0 in 0.223s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.471s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received event network-vif-plugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] Acquiring lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] No waiting events found dispatching network-vif-plugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:42 user nova-compute[74295]: WARNING nova.compute.manager [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received unexpected event network-vif-plugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 for instance with vm_state active and task_state None.
Oct 26 06:26:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received event network-vif-plugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] Acquiring lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] No waiting events found dispatching network-vif-plugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:42 user nova-compute[74295]: WARNING nova.compute.manager [req-cd144faf-f9cd-46a6-bbd4-f50d57377a96 req-0857e89a-aade-4d22-b1a8-a63fd72e525e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received unexpected event network-vif-plugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 for instance with vm_state active and task_state None.
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.251s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG nova.network.neutron [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Successfully created port: ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Cannot resize image /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Ensure instance console log exists: /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:26:43 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Instance spawned successfully.
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: INFO nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Took 11.67 seconds to spawn the instance on the hypervisor.
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:26:43 user nova-compute[74295]: INFO nova.compute.manager [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Took 14.73 seconds to build instance.
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:26:43 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Instance spawned successfully.
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-068a08ed-c822-4cfb-bbd9-6b66ab757d47 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.063s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:43 user nova-compute[74295]: INFO nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Took 13.71 seconds to spawn the instance on the hypervisor.
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.network.neutron [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Successfully updated port: ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquired lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.network.neutron [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:43 user nova-compute[74295]: INFO nova.compute.manager [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Took 15.81 seconds to build instance.
Oct 26 06:26:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5932829d-9c71-4d77-b042-68ccc2502ad6 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.056s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-d6cb3f32-c065-4fef-85fc-9f77331ff3b9 req-6f11ab71-1d27-4b9b-8a64-b770620359d7 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-changed-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-d6cb3f32-c065-4fef-85fc-9f77331ff3b9 req-6f11ab71-1d27-4b9b-8a64-b770620359d7 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Refreshing instance network info cache due to event network-changed-ba4ab381-015f-4485-8618-e7c48a5f0d26. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d6cb3f32-c065-4fef-85fc-9f77331ff3b9 req-6f11ab71-1d27-4b9b-8a64-b770620359d7 service nova] Acquiring lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:43 user nova-compute[74295]: DEBUG nova.network.neutron [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updating instance_info_cache with network_info: [{"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Releasing lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Instance network_info: |[{"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d6cb3f32-c065-4fef-85fc-9f77331ff3b9 req-6f11ab71-1d27-4b9b-8a64-b770620359d7 service nova] Acquired lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-d6cb3f32-c065-4fef-85fc-9f77331ff3b9 req-6f11ab71-1d27-4b9b-8a64-b770620359d7 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Refreshing network info cache for port ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Start _get_guest_xml network_info=[{"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:44 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:44 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235576379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235576379',id=9,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWyzCZKNfN++RdhZ7vCbqyQNIYdI761TFaG7JRpiZgjn40o6GYxEOHQNTFN5QLWKwFHwjbW8YmEMF7M/0RDutFK5QOejaU2AoitJ/iwiYQOMZr1KHRuqURWMhnnUXc/g==',key_name='tempest-keypair-916215385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5684b5893b604af484029883dbf5132b',ramdisk_id='',reservation_id='r-oovp6ig1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1270357865',owner_user_name='tempest-TaggedAttachmentsTest-1270357865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='620a58893e6f41a1ae1e57f672427d61',uuid=4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converting VIF {"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:fd:c1,bridge_name='br-int',has_traffic_filtering=True,id=ba4ab381-015f-4485-8618-e7c48a5f0d26,network=Network(b1dccdc9-7520-47f7-817b-5ab688e91d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4ab381-01') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.objects.instance [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lazy-loading 'pci_devices' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:44 user nova-compute[74295]:   <uuid>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</uuid>
Oct 26 06:26:44 user nova-compute[74295]:   <name>instance-00000009</name>
Oct 26 06:26:44 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:44 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:44 user nova-compute[74295]:   <metadata>
Oct 26 06:26:44 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:44 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:44 user nova-compute[74295]:       <nova:name>tempest-device-tagging-server-235576379</nova:name>
Oct 26 06:26:44 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:44</nova:creationTime>
Oct 26 06:26:44 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:44 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:44 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:44 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:44 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:44 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:44 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:44 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:44 user nova-compute[74295]:         <nova:user uuid="620a58893e6f41a1ae1e57f672427d61">tempest-TaggedAttachmentsTest-1270357865-project-member</nova:user>
Oct 26 06:26:44 user nova-compute[74295]:         <nova:project uuid="5684b5893b604af484029883dbf5132b">tempest-TaggedAttachmentsTest-1270357865</nova:project>
Oct 26 06:26:44 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:44 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:26:44 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:44 user nova-compute[74295]:         <nova:port uuid="ba4ab381-015f-4485-8618-e7c48a5f0d26">
Oct 26 06:26:44 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:26:44 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:44 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:44 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:44 user nova-compute[74295]:   </metadata>
Oct 26 06:26:44 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:44 user nova-compute[74295]:     <system>
Oct 26 06:26:44 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:44 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:44 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:44 user nova-compute[74295]:       <entry name="serial">4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:26:44 user nova-compute[74295]:       <entry name="uuid">4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:26:44 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:44 user nova-compute[74295]:     </system>
Oct 26 06:26:44 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:44 user nova-compute[74295]:   <os>
Oct 26 06:26:44 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:44 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:44 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:44 user nova-compute[74295]:   </os>
Oct 26 06:26:44 user nova-compute[74295]:   <features>
Oct 26 06:26:44 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:44 user nova-compute[74295]:     <apic/>
Oct 26 06:26:44 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:44 user nova-compute[74295]:   </features>
Oct 26 06:26:44 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:44 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:44 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:44 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:44 user nova-compute[74295]:   </clock>
Oct 26 06:26:44 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:44 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:44 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:44 user nova-compute[74295]:   </cpu>
Oct 26 06:26:44 user nova-compute[74295]:   <devices>
Oct 26 06:26:44 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:44 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:44 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk"/>
Oct 26 06:26:44 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:26:44 user nova-compute[74295]:     </disk>
Oct 26 06:26:44 user nova-compute[74295]:     <disk type="file" device="cdrom">
Oct 26 06:26:44 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 06:26:44 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.config"/>
Oct 26 06:26:44 user nova-compute[74295]:       <target dev="hda" bus="ide"/>
Oct 26 06:26:44 user nova-compute[74295]:     </disk>
Oct 26 06:26:44 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:44 user nova-compute[74295]:       <mac address="fa:16:3e:60:fd:c1"/>
Oct 26 06:26:44 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:44 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:44 user nova-compute[74295]:       <target dev="tapba4ab381-01"/>
Oct 26 06:26:44 user nova-compute[74295]:     </interface>
Oct 26 06:26:44 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:44 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log" append="off"/>
Oct 26 06:26:44 user nova-compute[74295]:     </serial>
Oct 26 06:26:44 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:44 user nova-compute[74295]:     <video>
Oct 26 06:26:44 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:44 user nova-compute[74295]:     </video>
Oct 26 06:26:44 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:44 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:44 user nova-compute[74295]:     </rng>
Oct 26 06:26:44 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:44 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:44 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:44 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:44 user nova-compute[74295]:   </devices>
Oct 26 06:26:44 user nova-compute[74295]: </domain>
Oct 26 06:26:44 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235576379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235576379',id=9,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWyzCZKNfN++RdhZ7vCbqyQNIYdI761TFaG7JRpiZgjn40o6GYxEOHQNTFN5QLWKwFHwjbW8YmEMF7M/0RDutFK5QOejaU2AoitJ/iwiYQOMZr1KHRuqURWMhnnUXc/g==',key_name='tempest-keypair-916215385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5684b5893b604af484029883dbf5132b',ramdisk_id='',reservation_id='r-oovp6ig1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1270357865',owner_user_name='tempest-TaggedAttachmentsTest-1270357865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='620a58893e6f41a1ae1e57f672427d61',uuid=4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converting VIF {"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:fd:c1,bridge_name='br-int',has_traffic_filtering=True,id=ba4ab381-015f-4485-8618-e7c48a5f0d26,network=Network(b1dccdc9-7520-47f7-817b-5ab688e91d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4ab381-01') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG os_vif [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:fd:c1,bridge_name='br-int',has_traffic_filtering=True,id=ba4ab381-015f-4485-8618-e7c48a5f0d26,network=Network(b1dccdc9-7520-47f7-817b-5ab688e91d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4ab381-01') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '226c7c79-3624-5fd4-810d-e2a2fc48f599', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4ab381-01, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba4ab381-01, col_values=(('qos', UUID('ffab6612-3157-4d5d-aa96-687ed14fa055')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba4ab381-01, col_values=(('external_ids', {'iface-id': 'ba4ab381-015f-4485-8618-e7c48a5f0d26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:fd:c1', 'vm-uuid': '4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:44 user nova-compute[74295]: INFO os_vif [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:fd:c1,bridge_name='br-int',has_traffic_filtering=True,id=ba4ab381-015f-4485-8618-e7c48a5f0d26,network=Network(b1dccdc9-7520-47f7-817b-5ab688e91d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4ab381-01')
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] No BDM found with device name hda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] No VIF found with MAC fa:16:3e:60:fd:c1, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:44 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Using config drive
Oct 26 06:26:45 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Creating config drive at /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.config
Oct 26 06:26:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpupzr910e {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:45 user nova-compute[74295]: DEBUG nova.network.neutron [req-d6cb3f32-c065-4fef-85fc-9f77331ff3b9 req-6f11ab71-1d27-4b9b-8a64-b770620359d7 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updated VIF entry in instance network info cache for port ba4ab381-015f-4485-8618-e7c48a5f0d26. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:45 user nova-compute[74295]: DEBUG nova.network.neutron [req-d6cb3f32-c065-4fef-85fc-9f77331ff3b9 req-6f11ab71-1d27-4b9b-8a64-b770620359d7 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updating instance_info_cache with network_info: [{"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpupzr910e" returned: 0 in 0.102s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d6cb3f32-c065-4fef-85fc-9f77331ff3b9 req-6f11ab71-1d27-4b9b-8a64-b770620359d7 service nova] Releasing lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-ab331f6d-9267-4ab3-a4f5-a952c51dda79 req-2afdcf5d-654c-432c-b2c2-10d44f539a82 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received event network-vif-plugged-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ab331f6d-9267-4ab3-a4f5-a952c51dda79 req-2afdcf5d-654c-432c-b2c2-10d44f539a82 service nova] Acquiring lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ab331f6d-9267-4ab3-a4f5-a952c51dda79 req-2afdcf5d-654c-432c-b2c2-10d44f539a82 service nova] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ab331f6d-9267-4ab3-a4f5-a952c51dda79 req-2afdcf5d-654c-432c-b2c2-10d44f539a82 service nova] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-ab331f6d-9267-4ab3-a4f5-a952c51dda79 req-2afdcf5d-654c-432c-b2c2-10d44f539a82 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] No waiting events found dispatching network-vif-plugged-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:45 user nova-compute[74295]: WARNING nova.compute.manager [req-ab331f6d-9267-4ab3-a4f5-a952c51dda79 req-2afdcf5d-654c-432c-b2c2-10d44f539a82 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received unexpected event network-vif-plugged-88b99f5b-7929-4948-8f2a-48c8d765b554 for instance with vm_state active and task_state None.
Oct 26 06:26:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:46 user nova-compute[74295]: WARNING nova.compute.manager [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state active and task_state None.
Oct 26 06:26:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:46 user nova-compute[74295]: WARNING nova.compute.manager [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state active and task_state None.
Oct 26 06:26:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received event network-vif-plugged-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] No waiting events found dispatching network-vif-plugged-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:46 user nova-compute[74295]: WARNING nova.compute.manager [req-b531d3a6-c9a4-41de-8c5d-128e9bd37dc4 req-4ebab082-2ad1-4007-aab4-ce6d8752f9bd service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received unexpected event network-vif-plugged-f90efd59-670f-4d95-9434-a9cbaf114f1d for instance with vm_state active and task_state None.
Oct 26 06:26:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-de39767c-b75b-4622-aa8e-91b96cca6416 req-4d204409-e116-4a4e-9582-012ff055f0a1 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received event network-vif-plugged-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-de39767c-b75b-4622-aa8e-91b96cca6416 req-4d204409-e116-4a4e-9582-012ff055f0a1 service nova] Acquiring lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-de39767c-b75b-4622-aa8e-91b96cca6416 req-4d204409-e116-4a4e-9582-012ff055f0a1 service nova] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-de39767c-b75b-4622-aa8e-91b96cca6416 req-4d204409-e116-4a4e-9582-012ff055f0a1 service nova] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-de39767c-b75b-4622-aa8e-91b96cca6416 req-4d204409-e116-4a4e-9582-012ff055f0a1 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] No waiting events found dispatching network-vif-plugged-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:47 user nova-compute[74295]: WARNING nova.compute.manager [req-de39767c-b75b-4622-aa8e-91b96cca6416 req-4d204409-e116-4a4e-9582-012ff055f0a1 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received unexpected event network-vif-plugged-88b99f5b-7929-4948-8f2a-48c8d765b554 for instance with vm_state active and task_state None.
Oct 26 06:26:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-d9426355-f8d7-45fb-a6c1-3e7efed4e2ff req-e9e1caf2-ef1d-4ef4-8675-2efbbf5e1b99 service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received event network-vif-plugged-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d9426355-f8d7-45fb-a6c1-3e7efed4e2ff req-e9e1caf2-ef1d-4ef4-8675-2efbbf5e1b99 service nova] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d9426355-f8d7-45fb-a6c1-3e7efed4e2ff req-e9e1caf2-ef1d-4ef4-8675-2efbbf5e1b99 service nova] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d9426355-f8d7-45fb-a6c1-3e7efed4e2ff req-e9e1caf2-ef1d-4ef4-8675-2efbbf5e1b99 service nova] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-d9426355-f8d7-45fb-a6c1-3e7efed4e2ff req-e9e1caf2-ef1d-4ef4-8675-2efbbf5e1b99 service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] No waiting events found dispatching network-vif-plugged-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:48 user nova-compute[74295]: WARNING nova.compute.manager [req-d9426355-f8d7-45fb-a6c1-3e7efed4e2ff req-e9e1caf2-ef1d-4ef4-8675-2efbbf5e1b99 service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received unexpected event network-vif-plugged-f90efd59-670f-4d95-9434-a9cbaf114f1d for instance with vm_state active and task_state None.
Oct 26 06:26:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:26:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:26:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Instance spawned successfully.
Oct 26 06:26:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:26:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:26:51 user nova-compute[74295]: INFO nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Took 9.60 seconds to spawn the instance on the hypervisor.
Oct 26 06:26:51 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:26:51 user nova-compute[74295]: INFO nova.compute.manager [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Took 11.06 seconds to build instance.
Oct 26 06:26:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a2a924a3-14b0-4699-a20a-34900bb1d8b6 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.245s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:26:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:26:52 user nova-compute[74295]: INFO nova.compute.claims [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Claim successful on node user
Oct 26 06:26:53 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG nova.network.neutron [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:26:53 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:26:53 user nova-compute[74295]: DEBUG nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG nova.policy [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf6cd88c450745f4b558791db9a54b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e5ffd74d124bf3806d9adabd96551e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:26:53 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Creating image(s)
Oct 26 06:26:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquiring lock "/opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "/opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "/opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.240s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.297s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk 1073741824" returned: 0 in 0.076s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.383s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:54 user nova-compute[74295]: DEBUG nova.network.neutron [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Successfully created port: 7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.366s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Cannot resize image /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Ensure instance console log exists: /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 06:26:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Successfully updated port: 7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquiring lock "refresh_cache-e86416be-82cc-4ab5-9d48-2173ea952bce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquired lock "refresh_cache-e86416be-82cc-4ab5-9d48-2173ea952bce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-bdc22554-6e83-43e3-bef4-32873f0889c1 req-4e35478c-528d-4733-917f-2963206249ac service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received event network-changed-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-bdc22554-6e83-43e3-bef4-32873f0889c1 req-4e35478c-528d-4733-917f-2963206249ac service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Refreshing instance network info cache due to event network-changed-7a6c064c-37ef-4322-90dc-a2113537cfb5. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bdc22554-6e83-43e3-bef4-32873f0889c1 req-4e35478c-528d-4733-917f-2963206249ac service nova] Acquiring lock "refresh_cache-e86416be-82cc-4ab5-9d48-2173ea952bce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Updating instance_info_cache with network_info: [{"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Releasing lock "refresh_cache-e86416be-82cc-4ab5-9d48-2173ea952bce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Instance network_info: |[{"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bdc22554-6e83-43e3-bef4-32873f0889c1 req-4e35478c-528d-4733-917f-2963206249ac service nova] Acquired lock "refresh_cache-e86416be-82cc-4ab5-9d48-2173ea952bce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:26:56 user nova-compute[74295]: DEBUG nova.network.neutron [req-bdc22554-6e83-43e3-bef4-32873f0889c1 req-4e35478c-528d-4733-917f-2963206249ac service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Refreshing network info cache for port 7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Start _get_guest_xml network_info=[{"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:26:57 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:57 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-781135046',display_name='tempest-VolumesAssistedSnapshotsTest-server-781135046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-781135046',id=10,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9VcYHexqhDvuIMQ2SCyp3YBVjg67WKScx/mgNA994EK4DYueP8pviBEAKnI9TLy9QlAmtV1V79X/uF5TJx7DSmqu86MKjqO6veViG/RfIV1rNNZR7lvBvKWvTzHp0HKg==',key_name='tempest-keypair-654166439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e5ffd74d124bf3806d9adabd96551e',ramdisk_id='',reservation_id='r-ew1hfpr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-591115203',owner_user_name='tempest-VolumesAssistedSnapshotsTest-591115203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf6cd88c450745f4b558791db9a54b50',uuid=e86416be-82cc-4ab5-9d48-2173ea952bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Converting VIF {"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:90:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a6c064c-37ef-4322-90dc-a2113537cfb5,network=Network(0afe623f-03fa-4121-b2f2-89872565fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6c064c-37') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lazy-loading 'pci_devices' on Instance uuid e86416be-82cc-4ab5-9d48-2173ea952bce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:26:57 user nova-compute[74295]:   <uuid>e86416be-82cc-4ab5-9d48-2173ea952bce</uuid>
Oct 26 06:26:57 user nova-compute[74295]:   <name>instance-0000000a</name>
Oct 26 06:26:57 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:26:57 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:26:57 user nova-compute[74295]:   <metadata>
Oct 26 06:26:57 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:26:57 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:26:57 user nova-compute[74295]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-781135046</nova:name>
Oct 26 06:26:57 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:26:57</nova:creationTime>
Oct 26 06:26:57 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:26:57 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:26:57 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:26:57 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:26:57 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:26:57 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:26:57 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:26:57 user nova-compute[74295]:       <nova:owner>
Oct 26 06:26:57 user nova-compute[74295]:         <nova:user uuid="cf6cd88c450745f4b558791db9a54b50">tempest-VolumesAssistedSnapshotsTest-591115203-project-member</nova:user>
Oct 26 06:26:57 user nova-compute[74295]:         <nova:project uuid="46e5ffd74d124bf3806d9adabd96551e">tempest-VolumesAssistedSnapshotsTest-591115203</nova:project>
Oct 26 06:26:57 user nova-compute[74295]:       </nova:owner>
Oct 26 06:26:57 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:26:57 user nova-compute[74295]:       <nova:ports>
Oct 26 06:26:57 user nova-compute[74295]:         <nova:port uuid="7a6c064c-37ef-4322-90dc-a2113537cfb5">
Oct 26 06:26:57 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 06:26:57 user nova-compute[74295]:         </nova:port>
Oct 26 06:26:57 user nova-compute[74295]:       </nova:ports>
Oct 26 06:26:57 user nova-compute[74295]:     </nova:instance>
Oct 26 06:26:57 user nova-compute[74295]:   </metadata>
Oct 26 06:26:57 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:26:57 user nova-compute[74295]:     <system>
Oct 26 06:26:57 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:26:57 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:26:57 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:26:57 user nova-compute[74295]:       <entry name="serial">e86416be-82cc-4ab5-9d48-2173ea952bce</entry>
Oct 26 06:26:57 user nova-compute[74295]:       <entry name="uuid">e86416be-82cc-4ab5-9d48-2173ea952bce</entry>
Oct 26 06:26:57 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:26:57 user nova-compute[74295]:     </system>
Oct 26 06:26:57 user nova-compute[74295]:   </sysinfo>
Oct 26 06:26:57 user nova-compute[74295]:   <os>
Oct 26 06:26:57 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:26:57 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:26:57 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:26:57 user nova-compute[74295]:   </os>
Oct 26 06:26:57 user nova-compute[74295]:   <features>
Oct 26 06:26:57 user nova-compute[74295]:     <acpi/>
Oct 26 06:26:57 user nova-compute[74295]:     <apic/>
Oct 26 06:26:57 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:26:57 user nova-compute[74295]:   </features>
Oct 26 06:26:57 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:26:57 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:26:57 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:26:57 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:26:57 user nova-compute[74295]:   </clock>
Oct 26 06:26:57 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:26:57 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:26:57 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:26:57 user nova-compute[74295]:   </cpu>
Oct 26 06:26:57 user nova-compute[74295]:   <devices>
Oct 26 06:26:57 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:26:57 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:26:57 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk"/>
Oct 26 06:26:57 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:26:57 user nova-compute[74295]:     </disk>
Oct 26 06:26:57 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:26:57 user nova-compute[74295]:       <mac address="fa:16:3e:90:90:2d"/>
Oct 26 06:26:57 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:57 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:26:57 user nova-compute[74295]:       <target dev="tap7a6c064c-37"/>
Oct 26 06:26:57 user nova-compute[74295]:     </interface>
Oct 26 06:26:57 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:26:57 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/console.log" append="off"/>
Oct 26 06:26:57 user nova-compute[74295]:     </serial>
Oct 26 06:26:57 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:26:57 user nova-compute[74295]:     <video>
Oct 26 06:26:57 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:26:57 user nova-compute[74295]:     </video>
Oct 26 06:26:57 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:26:57 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:26:57 user nova-compute[74295]:     </rng>
Oct 26 06:26:57 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:26:57 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:26:57 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:26:57 user nova-compute[74295]:     </memballoon>
Oct 26 06:26:57 user nova-compute[74295]:   </devices>
Oct 26 06:26:57 user nova-compute[74295]: </domain>
Oct 26 06:26:57 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-781135046',display_name='tempest-VolumesAssistedSnapshotsTest-server-781135046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-781135046',id=10,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9VcYHexqhDvuIMQ2SCyp3YBVjg67WKScx/mgNA994EK4DYueP8pviBEAKnI9TLy9QlAmtV1V79X/uF5TJx7DSmqu86MKjqO6veViG/RfIV1rNNZR7lvBvKWvTzHp0HKg==',key_name='tempest-keypair-654166439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e5ffd74d124bf3806d9adabd96551e',ramdisk_id='',reservation_id='r-ew1hfpr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-591115203',owner_user_name='tempest-VolumesAssistedSnapshotsTest-591115203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf6cd88c450745f4b558791db9a54b50',uuid=e86416be-82cc-4ab5-9d48-2173ea952bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Converting VIF {"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:90:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a6c064c-37ef-4322-90dc-a2113537cfb5,network=Network(0afe623f-03fa-4121-b2f2-89872565fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6c064c-37') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG os_vif [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:90:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a6c064c-37ef-4322-90dc-a2113537cfb5,network=Network(0afe623f-03fa-4121-b2f2-89872565fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6c064c-37') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e818546a-e6ea-5a1c-a30f-999f4f13a34f', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a6c064c-37, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a6c064c-37, col_values=(('qos', UUID('3738a158-13c2-456b-b749-e5481bdbf965')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a6c064c-37, col_values=(('external_ids', {'iface-id': '7a6c064c-37ef-4322-90dc-a2113537cfb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:90:2d', 'vm-uuid': 'e86416be-82cc-4ab5-9d48-2173ea952bce'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:57 user nova-compute[74295]: INFO os_vif [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:90:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a6c064c-37ef-4322-90dc-a2113537cfb5,network=Network(0afe623f-03fa-4121-b2f2-89872565fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6c064c-37')
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] No VIF found with MAC fa:16:3e:90:90:2d, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.network.neutron [req-bdc22554-6e83-43e3-bef4-32873f0889c1 req-4e35478c-528d-4733-917f-2963206249ac service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Updated VIF entry in instance network info cache for port 7a6c064c-37ef-4322-90dc-a2113537cfb5. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG nova.network.neutron [req-bdc22554-6e83-43e3-bef4-32873f0889c1 req-4e35478c-528d-4733-917f-2963206249ac service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Updating instance_info_cache with network_info: [{"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:26:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bdc22554-6e83-43e3-bef4-32873f0889c1 req-4e35478c-528d-4733-917f-2963206249ac service nova] Releasing lock "refresh_cache-e86416be-82cc-4ab5-9d48-2173ea952bce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:26:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-1db345e2-053e-456c-9918-f5268977bb06 req-52786e74-5395-447d-9116-fabf3c96fc45 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received event network-vif-plugged-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:26:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1db345e2-053e-456c-9918-f5268977bb06 req-52786e74-5395-447d-9116-fabf3c96fc45 service nova] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:26:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1db345e2-053e-456c-9918-f5268977bb06 req-52786e74-5395-447d-9116-fabf3c96fc45 service nova] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:26:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1db345e2-053e-456c-9918-f5268977bb06 req-52786e74-5395-447d-9116-fabf3c96fc45 service nova] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:26:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-1db345e2-053e-456c-9918-f5268977bb06 req-52786e74-5395-447d-9116-fabf3c96fc45 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] No waiting events found dispatching network-vif-plugged-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:26:58 user nova-compute[74295]: WARNING nova.compute.manager [req-1db345e2-053e-456c-9918-f5268977bb06 req-52786e74-5395-447d-9116-fabf3c96fc45 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received unexpected event network-vif-plugged-860eca16-317b-46e1-aa65-716d66e7b7ca for instance with vm_state active and task_state None.
Oct 26 06:26:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:59 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:26:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:26:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Skipping network cache update for instance because it is Building. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-c47a4c17-13ba-47af-9979-db4ddfc6dc46" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-c47a4c17-13ba-47af-9979-db4ddfc6dc46" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid c47a4c17-13ba-47af-9979-db4ddfc6dc46 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received event network-vif-plugged-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] No waiting events found dispatching network-vif-plugged-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:27:00 user nova-compute[74295]: WARNING nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received unexpected event network-vif-plugged-860eca16-317b-46e1-aa65-716d66e7b7ca for instance with vm_state active and task_state None.
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-plugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] No waiting events found dispatching network-vif-plugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:27:00 user nova-compute[74295]: WARNING nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received unexpected event network-vif-plugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 for instance with vm_state active and task_state None.
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-plugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] No waiting events found dispatching network-vif-plugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:27:00 user nova-compute[74295]: WARNING nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received unexpected event network-vif-plugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 for instance with vm_state active and task_state None.
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received event network-vif-plugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] No waiting events found dispatching network-vif-plugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:27:00 user nova-compute[74295]: WARNING nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received unexpected event network-vif-plugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 for instance with vm_state building and task_state spawning.
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received event network-vif-plugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:27:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] No waiting events found dispatching network-vif-plugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:27:00 user nova-compute[74295]: WARNING nova.compute.manager [req-74c35f91-965d-447e-8b2a-0f7429cccfab req-459cf29d-2715-4c36-986c-e25652aabf06 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received unexpected event network-vif-plugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 for instance with vm_state building and task_state spawning.
Oct 26 06:27:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Updating instance_info_cache with network_info: [{"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-c47a4c17-13ba-47af-9979-db4ddfc6dc46" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:27:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Instance spawned successfully.
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:27:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:01 user nova-compute[74295]: INFO nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Took 7.97 seconds to spawn the instance on the hypervisor.
Oct 26 06:27:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:27:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:02 user nova-compute[74295]: INFO nova.compute.manager [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Took 9.41 seconds to build instance.
Oct 26 06:27:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-599ce72c-a982-4563-91dd-4c99856cea30 tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.639s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:27:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:07 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:27:07 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7218MB free_disk=25.607955932617188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c47a4c17-13ba-47af-9979-db4ddfc6dc46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 46e224d1-67ea-4449-8952-4554bb302d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 88335730-9d04-4614-8c24-f0c3957418f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance e86416be-82cc-4ab5-9d48-2173ea952bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 06:27:07 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 06:27:08 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:27:08 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:27:08 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:27:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.098s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:27:08 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:27:08 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:27:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:27:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:27:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:27:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:27:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:27:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:27:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:27:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:27:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:27:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:27:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "a779935e-152e-4223-9a6a-166c9efc490a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:27:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:27:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:27:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:27:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:27:48 user nova-compute[74295]: INFO nova.compute.claims [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Claim successful on node user
Oct 26 06:27:49 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:27:49 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:27:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:27:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:27:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:27:49 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:27:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:27:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:27:49 user nova-compute[74295]: INFO nova.virt.block_device [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Booting with volume 3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 at /dev/vda
Oct 26 06:27:49 user nova-compute[74295]: DEBUG os_brick.utils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:27:49 user nova-compute[74295]: INFO oslo.privsep.daemon [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpdzc2ube3/privsep.sock']
Oct 26 06:27:49 user sudo[85960]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpdzc2ube3/privsep.sock
Oct 26 06:27:49 user sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 06:27:49 user nova-compute[74295]: DEBUG nova.policy [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7eb8edb200f44da9146778c13d49155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4f65d09e9b4024b32a54a536e65e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:27:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully created port: 41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:27:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully created port: 63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:27:51 user sudo[85960]: pam_unix(sudo:session): session closed for user root
Oct 26 06:27:51 user nova-compute[74295]: INFO oslo.privsep.daemon [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Spawned new privsep daemon via rootwrap
Oct 26 06:27:51 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 06:27:51 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 06:27:51 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 26 06:27:51 user nova-compute[74295]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85963
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e64b32-65e1-4539-a54c-352a9e63719b]: (2,) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52197e5-4aa5-491a-a72e-16512f9a9171]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:27:51 user nova-compute[74295]: WARNING os_brick.initiator.connectors.nvmeof [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26b8972-3672-409d-8cda-5a94c30f11dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf33fdee-4790-457b-bd3a-84c34df13d4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb61a1-1dc9-4d8c-9591-ff80f75358be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully created port: 38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:27:51 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:27:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[736f22ec-bdd0-430f-84a7-9afc0ceab4fc]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG os_brick.utils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] <== get_connector_properties: return (2042ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:27:51 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating existing volume attachment record: 74c1515f-a1b0-40c1-b723-cfe371f0f2d0 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:27:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully created port: c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:27:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully created port: 32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:27:53 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully updated port: 41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:27:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-54a9e24d-7db5-4f75-b3a4-db5f9289fc72 req-5ed35af3-d0a1-419b-ae30-b9eb475546f3 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-changed-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-54a9e24d-7db5-4f75-b3a4-db5f9289fc72 req-5ed35af3-d0a1-419b-ae30-b9eb475546f3 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing instance network info cache due to event network-changed-41528c15-0199-45b8-a577-d8c4bd0ecb82. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:27:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-54a9e24d-7db5-4f75-b3a4-db5f9289fc72 req-5ed35af3-d0a1-419b-ae30-b9eb475546f3 service nova] Acquiring lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-54a9e24d-7db5-4f75-b3a4-db5f9289fc72 req-5ed35af3-d0a1-419b-ae30-b9eb475546f3 service nova] Acquired lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:27:53 user nova-compute[74295]: DEBUG nova.network.neutron [req-54a9e24d-7db5-4f75-b3a4-db5f9289fc72 req-5ed35af3-d0a1-419b-ae30-b9eb475546f3 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing network info cache for port 41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:27:53 user nova-compute[74295]: DEBUG nova.network.neutron [req-54a9e24d-7db5-4f75-b3a4-db5f9289fc72 req-5ed35af3-d0a1-419b-ae30-b9eb475546f3 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:27:53 user nova-compute[74295]: DEBUG nova.network.neutron [req-54a9e24d-7db5-4f75-b3a4-db5f9289fc72 req-5ed35af3-d0a1-419b-ae30-b9eb475546f3 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:27:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-54a9e24d-7db5-4f75-b3a4-db5f9289fc72 req-5ed35af3-d0a1-419b-ae30-b9eb475546f3 service nova] Releasing lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:27:54 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully updated port: 83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:27:54 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully updated port: eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-changed-83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing instance network info cache due to event network-changed-83f63ce6-41bd-4816-b219-ea48b2f8d979. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] Acquiring lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] Acquired lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing network info cache for port 83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully updated port: 63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] Releasing lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-changed-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing instance network info cache due to event network-changed-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] Acquiring lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] Acquired lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing network info cache for port eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:27:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d3e63e37-7282-4d29-81ba-c3eb0fa6c20d req-e84263f9-8e29-4eb3-83d8-9067b84b7feb service nova] Releasing lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:27:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully updated port: 38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:27:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:27:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully updated port: c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-changed-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing instance network info cache due to event network-changed-63f85a57-2470-4601-bc41-05916fda216e. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] Acquiring lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] Acquired lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.network.neutron [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing network info cache for port 63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.network.neutron [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.network.neutron [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] Releasing lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-changed-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing instance network info cache due to event network-changed-38bb9e9c-3925-4527-8232-38b330b64587. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] Acquiring lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] Acquired lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.network.neutron [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing network info cache for port 38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.network.neutron [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:27:57 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Successfully updated port: 32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] Releasing lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-changed-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing instance network info cache due to event network-changed-c8c86686-cf6b-46b0-a433-e095f5ce79d7. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] Acquiring lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] Acquired lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing network info cache for port c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:27:58 user nova-compute[74295]: INFO nova.compute.manager [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] instance snapshotting
Oct 26 06:27:58 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Beginning live snapshot process
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b617b3bd-207f-4084-aa9b-5fdb71948dd0 req-f434ce34-ccc5-463a-8b56-6fb493d2d125 service nova] Releasing lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquired lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json -f qcow2 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:58 user nova-compute[74295]: INFO nova.compute.manager [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Rescuing
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquired lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json -f qcow2 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp21bu441k/a3f33ef954b341d0bc89f0b079e6fe89.delta 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp21bu441k/a3f33ef954b341d0bc89f0b079e6fe89.delta 1073741824" returned: 0 in 0.055s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:27:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 06:27:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74295) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 26 06:27:59 user nova-compute[74295]: INFO nova.virt.libvirt.host [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] UEFI support detected
Oct 26 06:27:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-e00a5ab0-31f2-4861-89be-95ad7e8a413e req-1b700457-1d32-4415-9159-d75f5e492e3f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-changed-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-e00a5ab0-31f2-4861-89be-95ad7e8a413e req-1b700457-1d32-4415-9159-d75f5e492e3f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing instance network info cache due to event network-changed-32c78116-87ad-4c2a-82bf-c9a044bbd42c. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e00a5ab0-31f2-4861-89be-95ad7e8a413e req-1b700457-1d32-4415-9159-d75f5e492e3f service nova] Acquiring lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updating instance_info_cache with network_info: [{"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Releasing lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:27:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-b16f4859-ddff-4ea5-8bfc-f1d36342ea5c req-df439167-e4d1-479c-9196-a9e09df65566 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-changed-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-b16f4859-ddff-4ea5-8bfc-f1d36342ea5c req-df439167-e4d1-479c-9196-a9e09df65566 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Refreshing instance network info cache due to event network-changed-f0e3fe7f-b73a-48b6-bc9d-adac272022b4. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b16f4859-ddff-4ea5-8bfc-f1d36342ea5c req-df439167-e4d1-479c-9196-a9e09df65566 service nova] Acquiring lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b16f4859-ddff-4ea5-8bfc-f1d36342ea5c req-df439167-e4d1-479c-9196-a9e09df65566 service nova] Acquired lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-b16f4859-ddff-4ea5-8bfc-f1d36342ea5c req-df439167-e4d1-479c-9196-a9e09df65566 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Refreshing network info cache for port f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:28:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c002695d-145c-4e74-90ae-aa1133680472] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:28:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Instance destroyed successfully.
Oct 26 06:28:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Attempting rescue
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74295) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp21bu441k/a3f33ef954b341d0bc89f0b079e6fe89.delta /opt/stack/data/nova/instances/snapshots/tmp21bu441k/a3f33ef954b341d0bc89f0b079e6fe89 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Instance directory exists: not creating {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 06:28:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Creating image(s)
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'trusted_certs' on Instance uuid b1d6362b-2ffb-4574-8f19-48855f6e7869 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.network.neutron [req-b16f4859-ddff-4ea5-8bfc-f1d36342ea5c req-df439167-e4d1-479c-9196-a9e09df65566 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updated VIF entry in instance network info cache for port f0e3fe7f-b73a-48b6-bc9d-adac272022b4. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.network.neutron [req-b16f4859-ddff-4ea5-8bfc-f1d36342ea5c req-df439167-e4d1-479c-9196-a9e09df65566 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance_info_cache with network_info: [{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b16f4859-ddff-4ea5-8bfc-f1d36342ea5c req-df439167-e4d1-479c-9196-a9e09df65566 service nova] Releasing lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.206s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue" returned: 0 in 0.052s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'migration_context' on Instance uuid b1d6362b-2ffb-4574-8f19-48855f6e7869 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.base [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<b1d6362b-2ffb-4574-8f19-48855f6e7869> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Start _get_guest_xml network_info=[{"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "vif_mac": "fa:16:3e:98:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'resources' on Instance uuid b1d6362b-2ffb-4574-8f19-48855f6e7869 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.base [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<b1d6362b-2ffb-4574-8f19-48855f6e7869> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'numa_topology' on Instance uuid b1d6362b-2ffb-4574-8f19-48855f6e7869 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.base [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<b1d6362b-2ffb-4574-8f19-48855f6e7869> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:01 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:28:01 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updating instance_info_cache with network_info: [{"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'vcpu_model' on Instance uuid b1d6362b-2ffb-4574-8f19-48855f6e7869 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.base [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<b1d6362b-2ffb-4574-8f19-48855f6e7869> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1772937373',display_name='tempest-ServerRescueNegativeTestJSON-server-1772937373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1772937373',id=5,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-a9t47yq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:26Z,user_data=None,user_id='3b0e86cf3ec049a58aee69c427717598',uuid=b1d6362b-2ffb-4574-8f19-48855f6e7869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "vif_mac": "fa:16:3e:98:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "vif_mac": "fa:16:3e:98:89:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f0a9975-465e-46c6-a0cf-777bcaf3a2df,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0a9975-46') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'pci_devices' on Instance uuid b1d6362b-2ffb-4574-8f19-48855f6e7869 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp21bu441k/a3f33ef954b341d0bc89f0b079e6fe89.delta /opt/stack/data/nova/instances/snapshots/tmp21bu441k/a3f33ef954b341d0bc89f0b079e6fe89" returned: 0 in 0.582s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:28:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Snapshot extracted, beginning image upload
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.objects.base [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<b1d6362b-2ffb-4574-8f19-48855f6e7869> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:28:01 user nova-compute[74295]:   <uuid>b1d6362b-2ffb-4574-8f19-48855f6e7869</uuid>
Oct 26 06:28:01 user nova-compute[74295]:   <name>instance-00000005</name>
Oct 26 06:28:01 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:28:01 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:28:01 user nova-compute[74295]:   <metadata>
Oct 26 06:28:01 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:28:01 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:28:01 user nova-compute[74295]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1772937373</nova:name>
Oct 26 06:28:01 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:28:01</nova:creationTime>
Oct 26 06:28:01 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:28:01 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:28:01 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:28:01 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:28:01 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:28:01 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:28:01 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:28:01 user nova-compute[74295]:       <nova:owner>
Oct 26 06:28:01 user nova-compute[74295]:         <nova:user uuid="3b0e86cf3ec049a58aee69c427717598">tempest-ServerRescueNegativeTestJSON-1373728584-project-member</nova:user>
Oct 26 06:28:01 user nova-compute[74295]:         <nova:project uuid="65c33a42f4b946d28de9e355927737e8">tempest-ServerRescueNegativeTestJSON-1373728584</nova:project>
Oct 26 06:28:01 user nova-compute[74295]:       </nova:owner>
Oct 26 06:28:01 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:28:01 user nova-compute[74295]:       <nova:ports>
Oct 26 06:28:01 user nova-compute[74295]:         <nova:port uuid="8f0a9975-465e-46c6-a0cf-777bcaf3a2df">
Oct 26 06:28:01 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 06:28:01 user nova-compute[74295]:         </nova:port>
Oct 26 06:28:01 user nova-compute[74295]:       </nova:ports>
Oct 26 06:28:01 user nova-compute[74295]:     </nova:instance>
Oct 26 06:28:01 user nova-compute[74295]:   </metadata>
Oct 26 06:28:01 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:28:01 user nova-compute[74295]:     <system>
Oct 26 06:28:01 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:28:01 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:28:01 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:28:01 user nova-compute[74295]:       <entry name="serial">b1d6362b-2ffb-4574-8f19-48855f6e7869</entry>
Oct 26 06:28:01 user nova-compute[74295]:       <entry name="uuid">b1d6362b-2ffb-4574-8f19-48855f6e7869</entry>
Oct 26 06:28:01 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:28:01 user nova-compute[74295]:     </system>
Oct 26 06:28:01 user nova-compute[74295]:   </sysinfo>
Oct 26 06:28:01 user nova-compute[74295]:   <os>
Oct 26 06:28:01 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:28:01 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:28:01 user nova-compute[74295]:   </os>
Oct 26 06:28:01 user nova-compute[74295]:   <features>
Oct 26 06:28:01 user nova-compute[74295]:     <acpi/>
Oct 26 06:28:01 user nova-compute[74295]:     <apic/>
Oct 26 06:28:01 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:28:01 user nova-compute[74295]:   </features>
Oct 26 06:28:01 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:28:01 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:28:01 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:28:01 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:28:01 user nova-compute[74295]:   </clock>
Oct 26 06:28:01 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:28:01 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:28:01 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:28:01 user nova-compute[74295]:   </cpu>
Oct 26 06:28:01 user nova-compute[74295]:   <devices>
Oct 26 06:28:01 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:28:01 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:28:01 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue"/>
Oct 26 06:28:01 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:28:01 user nova-compute[74295]:     </disk>
Oct 26 06:28:01 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:28:01 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:28:01 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk"/>
Oct 26 06:28:01 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:28:01 user nova-compute[74295]:     </disk>
Oct 26 06:28:01 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:28:01 user nova-compute[74295]:       <mac address="fa:16:3e:98:89:6f"/>
Oct 26 06:28:01 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:01 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:28:01 user nova-compute[74295]:       <target dev="tap8f0a9975-46"/>
Oct 26 06:28:01 user nova-compute[74295]:     </interface>
Oct 26 06:28:01 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:28:01 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/console.log" append="off"/>
Oct 26 06:28:01 user nova-compute[74295]:     </serial>
Oct 26 06:28:01 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:28:01 user nova-compute[74295]:     <video>
Oct 26 06:28:01 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:01 user nova-compute[74295]:     </video>
Oct 26 06:28:01 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:28:01 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:28:01 user nova-compute[74295]:     </rng>
Oct 26 06:28:01 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:28:01 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:28:01 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:28:01 user nova-compute[74295]:     </memballoon>
Oct 26 06:28:01 user nova-compute[74295]:   </devices>
Oct 26 06:28:01 user nova-compute[74295]: </domain>
Oct 26 06:28:01 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:28:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Instance destroyed successfully.
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No VIF found with MAC fa:16:3e:98:89:6f, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-unplugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-unplugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:28:02 user nova-compute[74295]: WARNING nova.compute.manager [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-unplugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state active and task_state rescuing.
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:28:02 user nova-compute[74295]: WARNING nova.compute.manager [req-8dc72852-11f6-4771-8584-904ac57a132e req-4bc80c41-b067-4240-b13c-958bf3bc287c service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state active and task_state rescuing.
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [{"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Releasing lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance network_info: |[{"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e00a5ab0-31f2-4861-89be-95ad7e8a413e req-1b700457-1d32-4415-9159-d75f5e492e3f service nova] Acquired lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.network.neutron [req-e00a5ab0-31f2-4861-89be-95ad7e8a413e req-1b700457-1d32-4415-9159-d75f5e492e3f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing network info cache for port 32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lazy-loading 'flavor' on Instance uuid c47a4c17-13ba-47af-9979-db4ddfc6dc46 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.network.neutron [req-e00a5ab0-31f2-4861-89be-95ad7e8a413e req-1b700457-1d32-4415-9159-d75f5e492e3f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updated VIF entry in instance network info cache for port 32c78116-87ad-4c2a-82bf-c9a044bbd42c. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG nova.network.neutron [req-e00a5ab0-31f2-4861-89be-95ad7e8a413e req-1b700457-1d32-4415-9159-d75f5e492e3f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [{"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e00a5ab0-31f2-4861-89be-95ad7e8a413e req-1b700457-1d32-4415-9159-d75f5e492e3f service nova] Releasing lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:02 user nova-compute[74295]: INFO nova.compute.manager [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Attaching volume b76ff580-c1a4-4c3b-851e-fde53b8aee5d to /dev/vdb
Oct 26 06:28:02 user nova-compute[74295]: DEBUG os_brick.utils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.034s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f118f-307c-48a8-9730-a7627175a3ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dba500-41b5-4a8d-b3fe-633f6dcc4798]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ba5b8-0bc7-48de-a3b1-d91787c4bb39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[96db77e2-fe3d-4f96-ae9b-20a89cc8fdc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:03 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa42f082-5f1a-489f-8435-7b4faae1a005]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG os_brick.utils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Updating existing volume attachment record: 936ea7d8-9d47-4f07-bc76-8744cf769dbf {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:28:04 user nova-compute[74295]: WARNING nova.compute.manager [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state active and task_state rescuing.
Oct 26 06:28:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:28:04 user nova-compute[74295]: WARNING nova.compute.manager [req-40a77e15-ff55-43aa-be64-08cc450b5e96 req-dbda17b5-f4ef-4afd-8745-c281c7eba2af service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state active and task_state rescuing.
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-fd5ccf20-a41b-4e37-87a2-77199bfcc36a req-ae7b718d-1dc4-47d7-8672-61f3be687610 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received event network-changed-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-fd5ccf20-a41b-4e37-87a2-77199bfcc36a req-ae7b718d-1dc4-47d7-8672-61f3be687610 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Refreshing instance network info cache due to event network-changed-6f426b1f-4f0b-43d7-aea7-6a6c3e130773. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fd5ccf20-a41b-4e37-87a2-77199bfcc36a req-ae7b718d-1dc4-47d7-8672-61f3be687610 service nova] Acquiring lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fd5ccf20-a41b-4e37-87a2-77199bfcc36a req-ae7b718d-1dc4-47d7-8672-61f3be687610 service nova] Acquired lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-fd5ccf20-a41b-4e37-87a2-77199bfcc36a req-ae7b718d-1dc4-47d7-8672-61f3be687610 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Refreshing network info cache for port 6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:04 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Snapshot image upload complete
Oct 26 06:28:04 user nova-compute[74295]: INFO nova.compute.manager [None req-7d7edbaf-f49d-4925-a31c-25ee82854481 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Took 6.65 seconds to snapshot the instance on the hypervisor.
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-fd5ccf20-a41b-4e37-87a2-77199bfcc36a req-ae7b718d-1dc4-47d7-8672-61f3be687610 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updated VIF entry in instance network info cache for port 6f426b1f-4f0b-43d7-aea7-6a6c3e130773. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-fd5ccf20-a41b-4e37-87a2-77199bfcc36a req-ae7b718d-1dc4-47d7-8672-61f3be687610 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updating instance_info_cache with network_info: [{"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fd5ccf20-a41b-4e37-87a2-77199bfcc36a req-ae7b718d-1dc4-47d7-8672-61f3be687610 service nova] Releasing lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2d234645-c73b-48ac-8878-fef340f2b153 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:08 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:28:08 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:28:08 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7163MB free_disk=25.46749496459961GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:28:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c47a4c17-13ba-47af-9979-db4ddfc6dc46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 46e224d1-67ea-4449-8952-4554bb302d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 88335730-9d04-4614-8c24-f0c3957418f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance e86416be-82cc-4ab5-9d48-2173ea952bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a779935e-152e-4223-9a6a-166c9efc490a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:28:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:28:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:12 user nova-compute[74295]: INFO nova.virt.block_device [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Booting with volume 0bc51339-d786-46e2-b165-25a1d819503b at /dev/vdb
Oct 26 06:28:12 user nova-compute[74295]: DEBUG os_brick.utils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c2889-915e-4e2c-9d1c-c3693741cb79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1019de-d6a5-47e2-b0cf-44cc33139514]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bacc71-ca75-49d8-bc23-873bbf2f401b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[01464ca4-271a-4e87-840f-8c323742466c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:12 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:28:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb4b249-c54b-439d-a7c9-1a83ca122de8]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG os_brick.utils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:12 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating existing volume attachment record: fd6ba1fd-4247-4ba1-80e1-cb40dc3067b5 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:28:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:18 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c8d8668-e158-4ab0-a071-b2fc286b4d6c req-70882436-4ab1-42a1-be50-e73f87cee22f service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received event network-changed-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:18 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c8d8668-e158-4ab0-a071-b2fc286b4d6c req-70882436-4ab1-42a1-be50-e73f87cee22f service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Refreshing instance network info cache due to event network-changed-f90efd59-670f-4d95-9434-a9cbaf114f1d. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:28:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c8d8668-e158-4ab0-a071-b2fc286b4d6c req-70882436-4ab1-42a1-be50-e73f87cee22f service nova] Acquiring lock "refresh_cache-46e224d1-67ea-4449-8952-4554bb302d98" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:28:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c8d8668-e158-4ab0-a071-b2fc286b4d6c req-70882436-4ab1-42a1-be50-e73f87cee22f service nova] Acquired lock "refresh_cache-46e224d1-67ea-4449-8952-4554bb302d98" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:18 user nova-compute[74295]: DEBUG nova.network.neutron [req-6c8d8668-e158-4ab0-a071-b2fc286b4d6c req-70882436-4ab1-42a1-be50-e73f87cee22f service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Refreshing network info cache for port f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-51cb7f77-cff6-4ca8-a9f3-54c31e27d54e req-8182ace7-ea38-4504-84ea-e3f62a6822cd service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received event network-changed-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-51cb7f77-cff6-4ca8-a9f3-54c31e27d54e req-8182ace7-ea38-4504-84ea-e3f62a6822cd service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Refreshing instance network info cache due to event network-changed-860eca16-317b-46e1-aa65-716d66e7b7ca. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-51cb7f77-cff6-4ca8-a9f3-54c31e27d54e req-8182ace7-ea38-4504-84ea-e3f62a6822cd service nova] Acquiring lock "refresh_cache-88335730-9d04-4614-8c24-f0c3957418f2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-51cb7f77-cff6-4ca8-a9f3-54c31e27d54e req-8182ace7-ea38-4504-84ea-e3f62a6822cd service nova] Acquired lock "refresh_cache-88335730-9d04-4614-8c24-f0c3957418f2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG nova.network.neutron [req-51cb7f77-cff6-4ca8-a9f3-54c31e27d54e req-8182ace7-ea38-4504-84ea-e3f62a6822cd service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Refreshing network info cache for port 860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG nova.network.neutron [req-6c8d8668-e158-4ab0-a071-b2fc286b4d6c req-70882436-4ab1-42a1-be50-e73f87cee22f service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Updated VIF entry in instance network info cache for port f90efd59-670f-4d95-9434-a9cbaf114f1d. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG nova.network.neutron [req-6c8d8668-e158-4ab0-a071-b2fc286b4d6c req-70882436-4ab1-42a1-be50-e73f87cee22f service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Updating instance_info_cache with network_info: [{"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c8d8668-e158-4ab0-a071-b2fc286b4d6c req-70882436-4ab1-42a1-be50-e73f87cee22f service nova] Releasing lock "refresh_cache-46e224d1-67ea-4449-8952-4554bb302d98" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG nova.network.neutron [req-51cb7f77-cff6-4ca8-a9f3-54c31e27d54e req-8182ace7-ea38-4504-84ea-e3f62a6822cd service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Updated VIF entry in instance network info cache for port 860eca16-317b-46e1-aa65-716d66e7b7ca. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:28:19 user nova-compute[74295]: DEBUG nova.network.neutron [req-51cb7f77-cff6-4ca8-a9f3-54c31e27d54e req-8182ace7-ea38-4504-84ea-e3f62a6822cd service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Updating instance_info_cache with network_info: [{"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-51cb7f77-cff6-4ca8-a9f3-54c31e27d54e req-8182ace7-ea38-4504-84ea-e3f62a6822cd service nova] Releasing lock "refresh_cache-88335730-9d04-4614-8c24-f0c3957418f2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connector [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Factory for ISCSI on None {{(pid=74295) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYXPwOxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:23 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:23 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:23 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[361b3888-9403-4128-b1a6-981a3b5445e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:28:23 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc41ff89-2086-4280-978e-2b9ce91b2992]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d] added
Oct 26 06:28:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ff3ad-b2c5-462f-b7cf-dc189df78e12]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[243c35f7-33b3-4330-9d42-ef8469cd39a7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYXPwOxc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYXPwOxc" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef57927-52cf-4c8f-83c5-58add7bd8577]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYXPwOxc'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ed6d82-4167-40b2-a079-d46cdc78cd9c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5f02e6-0eb2-406e-9515-35d48a95990d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 06:28:23 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 06:28:23 user nova-compute[74295]:  {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:23 user nova-compute[74295]: WARNING os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 06:28:23 user nova-compute[74295]: 
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90f38b1-4461-43c9-97c3-183168944702]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d, portal: 172.16.0.220,3260]
Oct 26 06:28:23 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d, portal: 172.16.0.220,3260] successful.
Oct 26 06:28:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ec44b-f3e7-47ae-9e87-f2b997e89685]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed45eca-a87c-412f-819c-6d7c074d90fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d (non-flash)
Oct 26 06:28:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d (non-flash)
Oct 26 06:28:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[214f3b9f-c2ed-49e2-bdfd-b4d4bd5a29fd]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:28:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYXPwOxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:28:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23831383062396164', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831383062396164', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:28:24 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lazy-loading 'flavor' on Instance uuid c47a4c17-13ba-47af-9979-db4ddfc6dc46 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:28:24 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:24 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:28:24 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:28:24 user nova-compute[74295]:   <serial>b76ff580-c1a4-4c3b-851e-fde53b8aee5d</serial>
Oct 26 06:28:24 user nova-compute[74295]: </disk>
Oct 26 06:28:24 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:28:24 user nova-compute[74295]: DEBUG nova.objects.instance [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lazy-loading 'flavor' on Instance uuid 46e224d1-67ea-4449-8952-4554bb302d98 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:25 user nova-compute[74295]: INFO nova.compute.manager [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Attaching volume 92f82807-b5b8-4bee-8219-8a56a11daefd to /dev/sdc
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.utils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e017f7c-3829-4973-999f-cb387350d3f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe00c8-bd50-4a3c-93de-5d1d73c21b93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a20286-aefa-40cf-ba0c-31b5d43bc728]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a55138-6ff6-460a-8340-4e004a4838b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] No VIF found with MAC fa:16:3e:53:1d:9b, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:25 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bdd076-27d4-4a7e-8a05-ab3943de01a8]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.utils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Updating existing volume attachment record: 62acf67f-f76e-4348-a4f0-7f0972c6af79 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3c8a47f7-22e5-4253-a858-1895087d75cb tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.535s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG nova.objects.instance [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lazy-loading 'flavor' on Instance uuid 88335730-9d04-4614-8c24-f0c3957418f2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:25 user nova-compute[74295]: INFO nova.compute.manager [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Attaching volume dbd3e5ca-f997-4202-9616-71ebe315fb65 to /dev/vdb
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.utils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb9a1ad-840b-406d-a352-c1c298446a4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a2f60a-2ea9-4611-8b5b-6db5049a6323]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fed34ff-2303-40b2-9acf-94e9b2038810]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7258414c-2dba-4493-a905-c0e46e81a8b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:25 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:28:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b627ff-f818-4265-821a-e756d54cf5ac]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG os_brick.utils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:25 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Updating existing volume attachment record: bd8aafd3-83df-4392-9695-a6bd44450e7f {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:28:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-ea9bbd20-ad50-4c97-913c-d199cbceecb3 req-5672bd84-2bd9-49a2-916c-be35472855e8 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-changed-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-ea9bbd20-ad50-4c97-913c-d199cbceecb3 req-5672bd84-2bd9-49a2-916c-be35472855e8 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Refreshing instance network info cache due to event network-changed-ba4ab381-015f-4485-8618-e7c48a5f0d26. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ea9bbd20-ad50-4c97-913c-d199cbceecb3 req-5672bd84-2bd9-49a2-916c-be35472855e8 service nova] Acquiring lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ea9bbd20-ad50-4c97-913c-d199cbceecb3 req-5672bd84-2bd9-49a2-916c-be35472855e8 service nova] Acquired lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.network.neutron [req-ea9bbd20-ad50-4c97-913c-d199cbceecb3 req-5672bd84-2bd9-49a2-916c-be35472855e8 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Refreshing network info cache for port ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.network.neutron [req-ea9bbd20-ad50-4c97-913c-d199cbceecb3 req-5672bd84-2bd9-49a2-916c-be35472855e8 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updated VIF entry in instance network info cache for port ba4ab381-015f-4485-8618-e7c48a5f0d26. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.network.neutron [req-ea9bbd20-ad50-4c97-913c-d199cbceecb3 req-5672bd84-2bd9-49a2-916c-be35472855e8 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updating instance_info_cache with network_info: [{"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ea9bbd20-ad50-4c97-913c-d199cbceecb3 req-5672bd84-2bd9-49a2-916c-be35472855e8 service nova] Releasing lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "interface-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "interface-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lazy-loading 'flavor' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lazy-loading 'pci_requests' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.objects.base [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Object Instance<4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08> lazy-loaded attributes: flavor,pci_requests {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:28:31 user nova-compute[74295]: DEBUG nova.policy [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '620a58893e6f41a1ae1e57f672427d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5684b5893b604af484029883dbf5132b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:28:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:32 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Successfully created port: 728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Successfully updated port: 728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquired lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-5766b6a2-70df-424c-a7a7-c27adce9b4b0 req-ac70ec0f-0ae3-448e-877a-a272f8be8d6e service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-changed-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-5766b6a2-70df-424c-a7a7-c27adce9b4b0 req-ac70ec0f-0ae3-448e-877a-a272f8be8d6e service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Refreshing instance network info cache due to event network-changed-728a6d93-5334-466c-ae8c-42a7b45d7383. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5766b6a2-70df-424c-a7a7-c27adce9b4b0 req-ac70ec0f-0ae3-448e-877a-a272f8be8d6e service nova] Acquiring lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:33 user nova-compute[74295]: INFO nova.compute.manager [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Terminating instance
Oct 26 06:28:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:33 user nova-compute[74295]: INFO nova.virt.block_device [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Booting with volume e023693d-1ce5-451a-97e7-09c20474a150 at /dev/vdc
Oct 26 06:28:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG os_brick.utils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e042ed7c-908d-4c36-8d8c-a0b73bb88ae4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4936e89b-88f6-4d6c-86f7-acc9de3f2eb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c0bf1e-1607-4407-8fe7-8e41ffee0ac6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2fe59-5810-447b-8cf8-d7199b3c6ee4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updating instance_info_cache with network_info: [{"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:34 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[370de14a-9d4a-4cf3-a600-3bf4ed1451c6]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.utils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating existing volume attachment record: 15c66f8d-f3b1-4850-9e26-4e50385e7244 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Releasing lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5766b6a2-70df-424c-a7a7-c27adce9b4b0 req-ac70ec0f-0ae3-448e-877a-a272f8be8d6e service nova] Acquired lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-5766b6a2-70df-424c-a7a7-c27adce9b4b0 req-ac70ec0f-0ae3-448e-877a-a272f8be8d6e service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Refreshing network info cache for port 728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235576379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235576379',id=9,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWyzCZKNfN++RdhZ7vCbqyQNIYdI761TFaG7JRpiZgjn40o6GYxEOHQNTFN5QLWKwFHwjbW8YmEMF7M/0RDutFK5QOejaU2AoitJ/iwiYQOMZr1KHRuqURWMhnnUXc/g==',key_name='tempest-keypair-916215385',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5684b5893b604af484029883dbf5132b',ramdisk_id='',reservation_id='r-oovp6ig1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1270357865',owner_user_name='tempest-TaggedAttachmentsTest-1270357865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='620a58893e6f41a1ae1e57f672427d61',uuid=4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converting VIF {"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_vif [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef29f70b-02de-565a-bf3c-10b6b1d40101', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap728a6d93-53, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap728a6d93-53, col_values=(('qos', UUID('c691f241-c964-4437-abbe-47291c60ada9')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap728a6d93-53, col_values=(('external_ids', {'iface-id': '728a6d93-5334-466c-ae8c-42a7b45d7383', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:7f:54', 'vm-uuid': '4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Instance destroyed successfully.
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lazy-loading 'resources' on Instance uuid c47a4c17-13ba-47af-9979-db4ddfc6dc46 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: INFO os_vif [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53')
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235576379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235576379',id=9,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWyzCZKNfN++RdhZ7vCbqyQNIYdI761TFaG7JRpiZgjn40o6GYxEOHQNTFN5QLWKwFHwjbW8YmEMF7M/0RDutFK5QOejaU2AoitJ/iwiYQOMZr1KHRuqURWMhnnUXc/g==',key_name='tempest-keypair-916215385',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5684b5893b604af484029883dbf5132b',ramdisk_id='',reservation_id='r-oovp6ig1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1270357865',owner_user_name='tempest-TaggedAttachmentsTest-1270357865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='620a58893e6f41a1ae1e57f672427d61',uuid=4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converting VIF {"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1573172271',display_name='tempest-DeleteServersTestJSON-server-1573172271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1573172271',id=1,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9afa806421043ee97a8bbec1a71d65a',ramdisk_id='',reservation_id='r-gh9xe1of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-84553156',owner_user_name='tempest-DeleteServersTestJSON-84553156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:26Z,user_data=None,user_id='5f168b3483604503af2d33a547c2b315',uuid=c47a4c17-13ba-47af-9979-db4ddfc6dc46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Converting VIF {"id": "88b99f5b-7929-4948-8f2a-48c8d765b554", "address": "fa:16:3e:53:1d:9b", "network": {"id": "0999bd3c-3495-4ff8-9d4f-68def80a64be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1468348823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9afa806421043ee97a8bbec1a71d65a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99f5b-79", "ovs_interfaceid": "88b99f5b-7929-4948-8f2a-48c8d765b554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:1d:9b,bridge_name='br-int',has_traffic_filtering=True,id=88b99f5b-7929-4948-8f2a-48c8d765b554,network=Network(0999bd3c-3495-4ff8-9d4f-68def80a64be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99f5b-79') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_vif [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:1d:9b,bridge_name='br-int',has_traffic_filtering=True,id=88b99f5b-7929-4948-8f2a-48c8d765b554,network=Network(0999bd3c-3495-4ff8-9d4f-68def80a64be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99f5b-79') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88b99f5b-79, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] attach device xml: <interface type="ethernet">
Oct 26 06:28:34 user nova-compute[74295]:   <mac address="fa:16:3e:f6:7f:54"/>
Oct 26 06:28:34 user nova-compute[74295]:   <model type="virtio"/>
Oct 26 06:28:34 user nova-compute[74295]:   <mtu size="1442"/>
Oct 26 06:28:34 user nova-compute[74295]:   <target dev="tap728a6d93-53"/>
Oct 26 06:28:34 user nova-compute[74295]: </interface>
Oct 26 06:28:34 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef8cf95e-196a-45e6-b3f1-9bf7878bda44) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: INFO os_vif [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:1d:9b,bridge_name='br-int',has_traffic_filtering=True,id=88b99f5b-7929-4948-8f2a-48c8d765b554,network=Network(0999bd3c-3495-4ff8-9d4f-68def80a64be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99f5b-79')
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYXPwOxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:34 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e52f403-dc69-4625-a03e-abe52f4127ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:28:34 user nova-compute[74295]: No targets found.
Oct 26 06:28:34 user nova-compute[74295]: iSNS:
Oct 26 06:28:34 user nova-compute[74295]: No targets found.
Oct 26 06:28:34 user nova-compute[74295]: STATIC:
Oct 26 06:28:34 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d
Oct 26 06:28:34 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:28:34 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:28:34 user nova-compute[74295]: FIRMWARE:
Oct 26 06:28:34 user nova-compute[74295]: No targets found.
Oct 26 06:28:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:28:34 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:28:34 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9f36e9-8db0-42ed-847d-52e610a33569]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccb4111-f128-43d4-b37d-dc2ca5ee213f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d (non-flash)
Oct 26 06:28:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d (non-flash)
Oct 26 06:28:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac53e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25cad9e-c930-4081-bb39-dd23a79a30a8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[312be4fc-f6be-4953-ba38-cd8b5f7b3b26]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6d523b-0825-4eae-ae2c-76a36e53c4f5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83d953b-01b5-4bbe-9f51-9d0559c121c2]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1bded0-7015-4de9-aa55-69ff1f2bc020]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d460d-793b-4010-b7c2-fad5384c5a8c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d, portal: 172.16.0.220,3260]
Oct 26 06:28:34 user nova-compute[74295]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d, portal: 172.16.0.220,3260] successful.
Oct 26 06:28:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76ff580-c1a4-4c3b-851e-fde53b8aee5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfce185-114a-4d50-aad5-50cc52c51c6f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] <== disconnect_volume: return (329ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:28:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Deleting instance files /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46_del
Oct 26 06:28:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Deletion of /opt/stack/data/nova/instances/c47a4c17-13ba-47af-9979-db4ddfc6dc46_del complete
Oct 26 06:28:34 user nova-compute[74295]: INFO nova.compute.manager [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Took 1.39 seconds to destroy the instance on the hypervisor.
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] No BDM found with device name hda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] No VIF found with MAC fa:16:3e:60:fd:c1, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:28:34 user nova-compute[74295]:   <nova:package version="0.0.0"/>
Oct 26 06:28:34 user nova-compute[74295]:   <nova:name>tempest-device-tagging-server-235576379</nova:name>
Oct 26 06:28:34 user nova-compute[74295]:   <nova:creationTime>2023-10-26 06:28:34</nova:creationTime>
Oct 26 06:28:34 user nova-compute[74295]:   <nova:flavor name="m1.tiny">
Oct 26 06:28:34 user nova-compute[74295]:     <nova:memory>512</nova:memory>
Oct 26 06:28:34 user nova-compute[74295]:     <nova:disk>1</nova:disk>
Oct 26 06:28:34 user nova-compute[74295]:     <nova:swap>0</nova:swap>
Oct 26 06:28:34 user nova-compute[74295]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:28:34 user nova-compute[74295]:     <nova:vcpus>1</nova:vcpus>
Oct 26 06:28:34 user nova-compute[74295]:   </nova:flavor>
Oct 26 06:28:34 user nova-compute[74295]:   <nova:owner>
Oct 26 06:28:34 user nova-compute[74295]:     <nova:user uuid="620a58893e6f41a1ae1e57f672427d61">tempest-TaggedAttachmentsTest-1270357865-project-member</nova:user>
Oct 26 06:28:34 user nova-compute[74295]:     <nova:project uuid="5684b5893b604af484029883dbf5132b">tempest-TaggedAttachmentsTest-1270357865</nova:project>
Oct 26 06:28:34 user nova-compute[74295]:   </nova:owner>
Oct 26 06:28:34 user nova-compute[74295]:   <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:28:34 user nova-compute[74295]:   <nova:ports>
Oct 26 06:28:34 user nova-compute[74295]:     <nova:port uuid="ba4ab381-015f-4485-8618-e7c48a5f0d26">
Oct 26 06:28:34 user nova-compute[74295]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:28:34 user nova-compute[74295]:     </nova:port>
Oct 26 06:28:34 user nova-compute[74295]:     <nova:port uuid="728a6d93-5334-466c-ae8c-42a7b45d7383">
Oct 26 06:28:34 user nova-compute[74295]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Oct 26 06:28:34 user nova-compute[74295]:     </nova:port>
Oct 26 06:28:34 user nova-compute[74295]:   </nova:ports>
Oct 26 06:28:34 user nova-compute[74295]: </nova:instance>
Oct 26 06:28:34 user nova-compute[74295]:  {{(pid=74295) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2b17bf12-22b9-44b8-a689-ccc682a712fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "interface-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.305s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-5766b6a2-70df-424c-a7a7-c27adce9b4b0 req-ac70ec0f-0ae3-448e-877a-a272f8be8d6e service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updated VIF entry in instance network info cache for port 728a6d93-5334-466c-ae8c-42a7b45d7383. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-5766b6a2-70df-424c-a7a7-c27adce9b4b0 req-ac70ec0f-0ae3-448e-877a-a272f8be8d6e service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updating instance_info_cache with network_info: [{"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5766b6a2-70df-424c-a7a7-c27adce9b4b0 req-ac70ec0f-0ae3-448e-877a-a272f8be8d6e service nova] Releasing lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received event network-vif-unplugged-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] Acquiring lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] No waiting events found dispatching network-vif-unplugged-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received event network-vif-unplugged-88b99f5b-7929-4948-8f2a-48c8d765b554 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received event network-vif-plugged-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] Acquiring lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] No waiting events found dispatching network-vif-plugged-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:28:35 user nova-compute[74295]: WARNING nova.compute.manager [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received unexpected event network-vif-plugged-88b99f5b-7929-4948-8f2a-48c8d765b554 for instance with vm_state active and task_state deleting.
Oct 26 06:28:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-plugged-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] No waiting events found dispatching network-vif-plugged-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:28:35 user nova-compute[74295]: WARNING nova.compute.manager [req-0ce40b40-194b-43fc-919a-09f84c3b4be3 req-f5270e84-4266-4b5d-916e-71db0e56e5a1 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received unexpected event network-vif-plugged-728a6d93-5334-466c-ae8c-42a7b45d7383 for instance with vm_state active and task_state None.
Oct 26 06:28:35 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:35 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Took 1.04 seconds to deallocate network for instance.
Oct 26 06:28:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-f208edda-ff77-4bff-a7c9-ca1ed23e4383 req-df907257-2a39-4a00-ba76-ad9a32e8c0fd service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Received event network-vif-deleted-88b99f5b-7929-4948-8f2a-48c8d765b554 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:36 user nova-compute[74295]: INFO nova.compute.manager [req-f208edda-ff77-4bff-a7c9-ca1ed23e4383 req-df907257-2a39-4a00-ba76-ad9a32e8c0fd service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Neutron deleted interface 88b99f5b-7929-4948-8f2a-48c8d765b554; detaching it from the instance and deleting it from the info cache
Oct 26 06:28:36 user nova-compute[74295]: DEBUG nova.network.neutron [req-f208edda-ff77-4bff-a7c9-ca1ed23e4383 req-df907257-2a39-4a00-ba76-ad9a32e8c0fd service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-f208edda-ff77-4bff-a7c9-ca1ed23e4383 req-df907257-2a39-4a00-ba76-ad9a32e8c0fd service nova] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Detach interface failed, port_id=88b99f5b-7929-4948-8f2a-48c8d765b554, reason: Instance c47a4c17-13ba-47af-9979-db4ddfc6dc46 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:28:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-6b8aa330-a923-45d5-a263-2dd954ef5a98 req-a55d3edc-be88-478a-9923-509c1fabdf04 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-plugged-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6b8aa330-a923-45d5-a263-2dd954ef5a98 req-a55d3edc-be88-478a-9923-509c1fabdf04 service nova] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6b8aa330-a923-45d5-a263-2dd954ef5a98 req-a55d3edc-be88-478a-9923-509c1fabdf04 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6b8aa330-a923-45d5-a263-2dd954ef5a98 req-a55d3edc-be88-478a-9923-509c1fabdf04 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-6b8aa330-a923-45d5-a263-2dd954ef5a98 req-a55d3edc-be88-478a-9923-509c1fabdf04 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] No waiting events found dispatching network-vif-plugged-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:28:37 user nova-compute[74295]: WARNING nova.compute.manager [req-6b8aa330-a923-45d5-a263-2dd954ef5a98 req-a55d3edc-be88-478a-9923-509c1fabdf04 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received unexpected event network-vif-plugged-728a6d93-5334-466c-ae8c-42a7b45d7383 for instance with vm_state active and task_state None.
Oct 26 06:28:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-f841178d-f762-4a85-8c2c-adbe1e92d112 req-df56ab01-6216-4465-abd7-0bd149a3a691 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received event network-changed-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:28:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-f841178d-f762-4a85-8c2c-adbe1e92d112 req-df56ab01-6216-4465-abd7-0bd149a3a691 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Refreshing instance network info cache due to event network-changed-7a6c064c-37ef-4322-90dc-a2113537cfb5. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:28:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f841178d-f762-4a85-8c2c-adbe1e92d112 req-df56ab01-6216-4465-abd7-0bd149a3a691 service nova] Acquiring lock "refresh_cache-e86416be-82cc-4ab5-9d48-2173ea952bce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:28:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f841178d-f762-4a85-8c2c-adbe1e92d112 req-df56ab01-6216-4465-abd7-0bd149a3a691 service nova] Acquired lock "refresh_cache-e86416be-82cc-4ab5-9d48-2173ea952bce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:28:43 user nova-compute[74295]: DEBUG nova.network.neutron [req-f841178d-f762-4a85-8c2c-adbe1e92d112 req-df56ab01-6216-4465-abd7-0bd149a3a691 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Refreshing network info cache for port 7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:28:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-f841178d-f762-4a85-8c2c-adbe1e92d112 req-df56ab01-6216-4465-abd7-0bd149a3a691 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Updated VIF entry in instance network info cache for port 7a6c064c-37ef-4322-90dc-a2113537cfb5. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:28:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-f841178d-f762-4a85-8c2c-adbe1e92d112 req-df56ab01-6216-4465-abd7-0bd149a3a691 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Updating instance_info_cache with network_info: [{"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:28:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f841178d-f762-4a85-8c2c-adbe1e92d112 req-df56ab01-6216-4465-abd7-0bd149a3a691 service nova] Releasing lock "refresh_cache-e86416be-82cc-4ab5-9d48-2173ea952bce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:28:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrwVOEUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:45 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:45 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:45 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4043f48a-71d3-4327-8816-45d02be1a8c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:28:45 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[de475c82-1094-4627-8382-a15471260d93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd] added
Oct 26 06:28:45 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b406b1-88c5-4c71-9f2b-40b9bde412ab]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd95fb75-e3e2-452d-bbca-9d2be82e37bb]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrwVOEUC {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrwVOEUC" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d904e0f0-3b45-4c12-92d9-82545cbb5860]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vrwVOEUC'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[450906c6-9de8-46e8-aeb0-2d1413bbbbb0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fd1f24-958c-4c10-93e1-05a7812876f7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 06:28:45 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 06:28:45 user nova-compute[74295]:  {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:45 user nova-compute[74295]: WARNING os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 06:28:45 user nova-compute[74295]: 
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG nova.objects.instance [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lazy-loading 'flavor' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[51629697-40d2-49b7-aa2e-1ba0bce9682b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd, portal: 172.16.0.220,3260]
Oct 26 06:28:45 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd, portal: 172.16.0.220,3260] successful.
Oct 26 06:28:45 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7130e06e-d070-471b-8421-dcf48557279c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[488fd035-9998-4ab8-8a2a-c8a553bacc4a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:45 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:45 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d92dd-48d2-427e-9da8-7de228e20b11]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrtbBNeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:45 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG nova.objects.instance [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lazy-loading 'flavor' on Instance uuid e86416be-82cc-4ab5-9d48-2173ea952bce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:46 user nova-compute[74295]: INFO nova.compute.manager [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] [instance: c47a4c17-13ba-47af-9979-db4ddfc6dc46] Took 10.34 seconds to detach 1 volumes for instance.
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:46 user nova-compute[74295]: INFO nova.compute.manager [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Attaching volume c1f94a2f-06d3-4ade-ba69-fee194916361 to /dev/vdb
Oct 26 06:28:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:46 user nova-compute[74295]: INFO nova.compute.manager [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Attaching volume 32383492-4c08-4b85-b1df-17387f582514 to /dev/vdb
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrwVOEUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26530316631356334', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530316631356334', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.531s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:46 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:46 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG nova.objects.instance [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lazy-loading 'flavor' on Instance uuid 46e224d1-67ea-4449-8952-4554bb302d98 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8b0f92-2a70-48a9-963a-ad5bdede888b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:28:46 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:28:46 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:46 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:28:46 user nova-compute[74295]:   <target dev="sdc" bus="scsi"/>
Oct 26 06:28:46 user nova-compute[74295]:   <serial>92f82807-b5b8-4bee-8219-8a56a11daefd</serial>
Oct 26 06:28:46 user nova-compute[74295]:   <address type="drive" controller="0" unit="2"/>
Oct 26 06:28:46 user nova-compute[74295]: </disk>
Oct 26 06:28:46 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.utils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77479e6-6172-440f-aaef-c960485333ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c713ca-1993-4123-a5af-af711f58dbf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65] added
Oct 26 06:28:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29763b1-3a1e-49a2-ae1a-cfe6a458e655]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5645c2ec-e053-40f0-bb83-401b7c27a972]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c6f91f-c598-46f0-bbfb-b501a08155ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b72ebf-f090-45cb-a4e1-275c79e2f560]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d76d5a-aafc-4234-bf0a-99842b46bde0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.utils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrtbBNeA {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrtbBNeA" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a722928e-1d7e-404b-8b94-22c326ccb6d4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hrtbBNeA'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6f8503-0699-4cd9-b9d5-d7dbc5d7639c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:46 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[838395f4-d347-4438-868a-2eb2602ea941]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.utils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updating existing volume attachment record: c0186b24-ffa4-440a-b266-7fdab4cc0507 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8683c121-b266-4bed-b8f0-7efcbc0e22b4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2522c915-e0ea-4f3e-8023-2e2d64d9da34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a995696-5cae-43b8-bdd4-3e83e13b7055]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d360e754-072e-4877-8ef4-98333d1634bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[505168a5-0191-4bbd-8d7c-6903f862adc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[373374fa-9fdb-4d3b-9347-edffb8400f9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:28:46 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbc3c4e-b045-4443-8145-f22042794a5e]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65, portal: 172.16.0.220,3260]
Oct 26 06:28:46 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65, portal: 172.16.0.220,3260] successful.
Oct 26 06:28:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.utils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Updating existing volume attachment record: 5b908883-97f9-44d0-af57-c14094b08aa1 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc33865b-8ebb-484c-83c7-3f3c027bd00b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c2296f-d641-4f51-8f75-34e5bcf12189]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:46 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:46 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:46 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Deleted allocations for instance c47a4c17-13ba-47af-9979-db4ddfc6dc46
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0ff0d3-0361-4109-b775-8bcd97a1b323]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:28:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrtbBNeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] No BDM found with device name sda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] No VIF found with MAC fa:16:3e:bb:e0:25, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5e81aa4c-71e5-4665-b89c-9b66e2aee80c tempest-DeleteServersTestJSON-84553156 tempest-DeleteServersTestJSON-84553156-project-member] Lock "c47a4c17-13ba-47af-9979-db4ddfc6dc46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.667s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] <== connect_volume: return (1981ms) {'type': 'block', 'scsi_wwn': '23865343736333563', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865343736333563', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG nova.objects.instance [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lazy-loading 'flavor' on Instance uuid 88335730-9d04-4614-8c24-f0c3957418f2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:28:47 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:47 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:28:47 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:28:47 user nova-compute[74295]:   <serial>dbd3e5ca-f997-4202-9616-71ebe315fb65</serial>
Oct 26 06:28:47 user nova-compute[74295]: </disk>
Oct 26 06:28:47 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:28:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:28:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] No VIF found with MAC fa:16:3e:f0:ae:bc, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:28:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-815e116b-46c9-42a7-bc38-5c4fa10d5acc tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.010s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-09f6e1bf-b555-455c-a7d8-2a22508ba8f9 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.692s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:28:55 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Creating image(s)
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Ensure instance console log exists: /opt/stack/data/nova/instances/a779935e-152e-4223-9a6a-166c9efc490a/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Start _get_guest_xml network_info=[{"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '74c1515f-a1b0-40c1-b723-cfe371f0f2d0', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AauQjdLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a779935e-152e-4223-9a6a-166c9efc490a', 'attached_at': '', 'detached_at': '', 'volume_id': '3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77', 'serial': '3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77'}, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': 'fd6ba1fd-4247-4ba1-80e1-cb40dc3067b5', 'boot_index': 1, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdSUbeqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a779935e-152e-4223-9a6a-166c9efc490a', 'attached_at': '', 'detached_at': '', 'volume_id': '0bc51339-d786-46e2-b165-25a1d819503b', 'serial': '0bc51339-d786-46e2-b165-25a1d819503b'}, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '15c66f8d-f3b1-4850-9e26-4e50385e7244', 'boot_index': 2, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoRMiFYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a779935e-152e-4223-9a6a-166c9efc490a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e023693d-1ce5-451a-97e7-09c20474a150', 'serial': 'e023693d-1ce5-451a-97e7-09c20474a150'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:28:55 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:28:55 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AauQjdLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:55 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:55 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:55 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da1f9ac-b772-4b70-bbb4-ef3ee2b8c5a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:28:55 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad918b0e-eb6e-4cc1-a16f-efa0866f4c7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77] added
Oct 26 06:28:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd7097b-b595-4340-96ec-38077dc55a1a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1b3bcc-4486-4dea-aedf-36d7711e9f15]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AauQjdLh {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AauQjdLh" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b2a372-e998-423f-bcc3-e18cfcfaae97]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AauQjdLh'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[797895d8-a695-4f50-9ea2-bd5580552cf4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[58183958-66f9-4fc1-bb8c-51f102ff0581]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:55 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:55 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf99d56e-9626-4529-955b-fca9a4ccaea1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77, portal: 172.16.0.220,3260]
Oct 26 06:28:55 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77, portal: 172.16.0.220,3260] successful.
Oct 26 06:28:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d2c5c-3e66-4c9c-ae81-028074835e3e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc235d1c-44d2-4207-b056-304140d36214]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:55 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:55 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:55 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:55 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aeb47a-597c-4c89-99be-4827b78e79fd]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:28:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AauQjdLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:56 user nova-compute[74295]: INFO nova.compute.manager [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Detaching volume 92f82807-b5b8-4bee-8219-8a56a11daefd
Oct 26 06:28:56 user nova-compute[74295]: INFO nova.virt.block_device [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Attempting to driver detach volume 92f82807-b5b8-4bee-8219-8a56a11daefd from mountpoint /dev/sdc
Oct 26 06:28:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Attempting to detach device sdc from instance 46e224d1-67ea-4449-8952-4554bb302d98 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:28:56 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:56 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:28:56 user nova-compute[74295]:   <target dev="sdc" bus="scsi"/>
Oct 26 06:28:56 user nova-compute[74295]:   <serial>92f82807-b5b8-4bee-8219-8a56a11daefd</serial>
Oct 26 06:28:56 user nova-compute[74295]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 06:28:56 user nova-compute[74295]: </disk>
Oct 26 06:28:56 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:28:56 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Successfully detached device sdc from instance 46e224d1-67ea-4449-8952-4554bb302d98 from the persistent domain config.
Oct 26 06:28:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 46e224d1-67ea-4449-8952-4554bb302d98 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:28:56 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:56 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:28:56 user nova-compute[74295]:   <target dev="sdc" bus="scsi"/>
Oct 26 06:28:56 user nova-compute[74295]:   <serial>92f82807-b5b8-4bee-8219-8a56a11daefd</serial>
Oct 26 06:28:56 user nova-compute[74295]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 06:28:56 user nova-compute[74295]: </disk>
Oct 26 06:28:56 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 46e224d1-67ea-4449-8952-4554bb302d98 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26237383335356233', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237383335356233', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdSUbeqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:56 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:56 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:56 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:28:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daaaf29-9928-4da6-aa23-e62df56e006f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:28:57 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a71bf5-a14d-41f0-bf6b-daab68a0db0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b] added
Oct 26 06:28:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c3b4f1-dfb9-41f1-9b26-c6aa63ad32bc]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6fe7f-f1a8-4666-ba11-2b151051d9d7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdSUbeqA {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdSUbeqA" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30db5bd-d25d-4462-827f-abad811e4276]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KdSUbeqA'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6631262a-3597-48e6-9c57-c64c2927e39d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: INFO nova.compute.manager [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Detaching volume dbd3e5ca-f997-4202-9616-71ebe315fb65
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a4b2f0-76f2-4855-88c6-1afa5527fa30]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d6904b-082c-449b-9ac2-fb9f0393524e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b, portal: 172.16.0.220,3260]
Oct 26 06:28:57 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b, portal: 172.16.0.220,3260] successful.
Oct 26 06:28:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d97b2d-e73e-4497-891f-8eb3e71a50e5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4da7f9-e188-4dc0-adf7-2cca23ad7321]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:28:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:57 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:28:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[79748ebf-69c4-4331-a18e-e7e5ef1ff929]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdSUbeqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:28:57 user nova-compute[74295]: INFO nova.virt.block_device [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Attempting to driver detach volume dbd3e5ca-f997-4202-9616-71ebe315fb65 from mountpoint /dev/vdb
Oct 26 06:28:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Attempting to detach device vdb from instance 88335730-9d04-4614-8c24-f0c3957418f2 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:28:57 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:57 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:28:57 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:28:57 user nova-compute[74295]:   <serial>dbd3e5ca-f997-4202-9616-71ebe315fb65</serial>
Oct 26 06:28:57 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:28:57 user nova-compute[74295]: </disk>
Oct 26 06:28:57 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:28:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Successfully detached device vdb from instance 88335730-9d04-4614-8c24-f0c3957418f2 from the persistent domain config.
Oct 26 06:28:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88335730-9d04-4614-8c24-f0c3957418f2 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:28:57 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:57 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:28:57 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:28:57 user nova-compute[74295]:   <serial>dbd3e5ca-f997-4202-9616-71ebe315fb65</serial>
Oct 26 06:28:57 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:28:57 user nova-compute[74295]: </disk>
Oct 26 06:28:57 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:28:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88335730-9d04-4614-8c24-f0c3957418f2 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23031643637316632', 'path': '/dev/sde'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031643637316632', 'path': '/dev/sde'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoRMiFYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:28:58 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:58 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:28:58 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d9fbec-a0fe-44df-9b47-d99d0f79b0ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:28:58 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c8a9d1-789b-4ff6-a4b4-e7b512bb642a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150] added
Oct 26 06:28:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdfb115-9811-4290-8776-75e6d378cd0c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[052a0100-0074-4447-92ca-5e40d15e4040]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoRMiFYv {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoRMiFYv" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[770a3d5c-a298-4435-839a-ea6c524a314b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JoRMiFYv'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d07ab5-4703-4ac9-a4ba-da49b671b280]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8525e76c-ba0b-4a7f-a393-00fb0c306e38]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:28:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:28:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86b3bd6-83cd-449b-8f03-ccde4ce2b969]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150, portal: 172.16.0.220,3260]
Oct 26 06:28:58 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150, portal: 172.16.0.220,3260] successful.
Oct 26 06:28:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0dd4dc-7810-42f7-a4b6-dbd5e646647c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5630c3a-0ee5-4e7e-9c23-16c654fea83b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:28:58 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:28:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ca7cda-07c1-4866-b505-3fd787cf80ff]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:28:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoRMiFYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23038383838303466', 'path': '/dev/sdf'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038383838303466', 'path': '/dev/sdf'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:72:02,bridge_name='br-int',has_traffic_filtering=True,id=41528c15-0199-45b8-a577-d8c4bd0ecb82,network=Network(01ec9754-956c-4aa5-b9d1-9daa78e8679f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41528c15-01') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:68:a4,bridge_name='br-int',has_traffic_filtering=True,id=83f63ce6-41bd-4816-b219-ea48b2f8d979,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83f63ce6-41') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8a:76,bridge_name='br-int',has_traffic_filtering=True,id=eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb14b7e5-90') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=63f85a57-2470-4601-bc41-05916fda216e,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f85a57-24') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:34,bridge_name='br-int',has_traffic_filtering=True,id=38bb9e9c-3925-4527-8232-38b330b64587,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bb9e9c-39') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:d1:64,bridge_name='br-int',has_traffic_filtering=True,id=c8c86686-cf6b-46b0-a433-e095f5ce79d7,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8c86686-cf') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:e1,bridge_name='br-int',has_traffic_filtering=True,id=32c78116-87ad-4c2a-82bf-c9a044bbd42c,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c78116-87') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.objects.instance [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lazy-loading 'pci_devices' on Instance uuid a779935e-152e-4223-9a6a-166c9efc490a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:28:59 user nova-compute[74295]:   <uuid>a779935e-152e-4223-9a6a-166c9efc490a</uuid>
Oct 26 06:28:59 user nova-compute[74295]:   <name>instance-0000000b</name>
Oct 26 06:28:59 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:28:59 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:28:59 user nova-compute[74295]:   <metadata>
Oct 26 06:28:59 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:28:59 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:28:59 user nova-compute[74295]:       <nova:name>tempest-device-tagging-server-2085971327</nova:name>
Oct 26 06:28:59 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:28:55</nova:creationTime>
Oct 26 06:28:59 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:28:59 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:28:59 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:28:59 user nova-compute[74295]:       <nova:owner>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:user uuid="e7eb8edb200f44da9146778c13d49155">tempest-TaggedBootDevicesTest_v242-1053262634-project-member</nova:user>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:project uuid="df4f65d09e9b4024b32a54a536e65e33">tempest-TaggedBootDevicesTest_v242-1053262634</nova:project>
Oct 26 06:28:59 user nova-compute[74295]:       </nova:owner>
Oct 26 06:28:59 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:28:59 user nova-compute[74295]:       <nova:ports>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:port uuid="41528c15-0199-45b8-a577-d8c4bd0ecb82">
Oct 26 06:28:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 06:28:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:port uuid="83f63ce6-41bd-4816-b219-ea48b2f8d979">
Oct 26 06:28:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.1.1.87" ipVersion="4"/>
Oct 26 06:28:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:port uuid="eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b">
Oct 26 06:28:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Oct 26 06:28:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:port uuid="63f85a57-2470-4601-bc41-05916fda216e">
Oct 26 06:28:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.1.1.221" ipVersion="4"/>
Oct 26 06:28:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:port uuid="38bb9e9c-3925-4527-8232-38b330b64587">
Oct 26 06:28:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Oct 26 06:28:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:port uuid="c8c86686-cf6b-46b0-a433-e095f5ce79d7">
Oct 26 06:28:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 06:28:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:28:59 user nova-compute[74295]:         <nova:port uuid="32c78116-87ad-4c2a-82bf-c9a044bbd42c">
Oct 26 06:28:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 06:28:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:28:59 user nova-compute[74295]:       </nova:ports>
Oct 26 06:28:59 user nova-compute[74295]:     </nova:instance>
Oct 26 06:28:59 user nova-compute[74295]:   </metadata>
Oct 26 06:28:59 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:28:59 user nova-compute[74295]:     <system>
Oct 26 06:28:59 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:28:59 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:28:59 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:28:59 user nova-compute[74295]:       <entry name="serial">a779935e-152e-4223-9a6a-166c9efc490a</entry>
Oct 26 06:28:59 user nova-compute[74295]:       <entry name="uuid">a779935e-152e-4223-9a6a-166c9efc490a</entry>
Oct 26 06:28:59 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:28:59 user nova-compute[74295]:     </system>
Oct 26 06:28:59 user nova-compute[74295]:   </sysinfo>
Oct 26 06:28:59 user nova-compute[74295]:   <os>
Oct 26 06:28:59 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:28:59 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:28:59 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:28:59 user nova-compute[74295]:   </os>
Oct 26 06:28:59 user nova-compute[74295]:   <features>
Oct 26 06:28:59 user nova-compute[74295]:     <acpi/>
Oct 26 06:28:59 user nova-compute[74295]:     <apic/>
Oct 26 06:28:59 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:28:59 user nova-compute[74295]:   </features>
Oct 26 06:28:59 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:28:59 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:28:59 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:28:59 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:28:59 user nova-compute[74295]:   </clock>
Oct 26 06:28:59 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:28:59 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:28:59 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:28:59 user nova-compute[74295]:   </cpu>
Oct 26 06:28:59 user nova-compute[74295]:   <devices>
Oct 26 06:28:59 user nova-compute[74295]:     <disk type="file" device="cdrom">
Oct 26 06:28:59 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 06:28:59 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/a779935e-152e-4223-9a6a-166c9efc490a/disk.config"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="hda" bus="ide"/>
Oct 26 06:28:59 user nova-compute[74295]:     </disk>
Oct 26 06:28:59 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:28:59 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:59 user nova-compute[74295]:       <source dev="/dev/sdd"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <serial>3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77</serial>
Oct 26 06:28:59 user nova-compute[74295]:     </disk>
Oct 26 06:28:59 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:28:59 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:59 user nova-compute[74295]:       <source dev="/dev/sde"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <serial>0bc51339-d786-46e2-b165-25a1d819503b</serial>
Oct 26 06:28:59 user nova-compute[74295]:     </disk>
Oct 26 06:28:59 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:28:59 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:28:59 user nova-compute[74295]:       <source dev="/dev/sdf"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="vdc" bus="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <serial>e023693d-1ce5-451a-97e7-09c20474a150</serial>
Oct 26 06:28:59 user nova-compute[74295]:     </disk>
Oct 26 06:28:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:28:59 user nova-compute[74295]:       <mac address="fa:16:3e:4c:72:02"/>
Oct 26 06:28:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="tap41528c15-01"/>
Oct 26 06:28:59 user nova-compute[74295]:     </interface>
Oct 26 06:28:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:28:59 user nova-compute[74295]:       <mac address="fa:16:3e:99:68:a4"/>
Oct 26 06:28:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="tap83f63ce6-41"/>
Oct 26 06:28:59 user nova-compute[74295]:     </interface>
Oct 26 06:28:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:28:59 user nova-compute[74295]:       <mac address="fa:16:3e:c8:8a:76"/>
Oct 26 06:28:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="tapeb14b7e5-90"/>
Oct 26 06:28:59 user nova-compute[74295]:     </interface>
Oct 26 06:28:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:28:59 user nova-compute[74295]:       <mac address="fa:16:3e:16:ca:d5"/>
Oct 26 06:28:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="tap63f85a57-24"/>
Oct 26 06:28:59 user nova-compute[74295]:     </interface>
Oct 26 06:28:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:28:59 user nova-compute[74295]:       <mac address="fa:16:3e:23:98:34"/>
Oct 26 06:28:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="tap38bb9e9c-39"/>
Oct 26 06:28:59 user nova-compute[74295]:     </interface>
Oct 26 06:28:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:28:59 user nova-compute[74295]:       <mac address="fa:16:3e:06:d1:64"/>
Oct 26 06:28:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="tapc8c86686-cf"/>
Oct 26 06:28:59 user nova-compute[74295]:     </interface>
Oct 26 06:28:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:28:59 user nova-compute[74295]:       <mac address="fa:16:3e:9a:04:e1"/>
Oct 26 06:28:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:28:59 user nova-compute[74295]:       <target dev="tap32c78116-87"/>
Oct 26 06:28:59 user nova-compute[74295]:     </interface>
Oct 26 06:28:59 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:28:59 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/a779935e-152e-4223-9a6a-166c9efc490a/console.log" append="off"/>
Oct 26 06:28:59 user nova-compute[74295]:     </serial>
Oct 26 06:28:59 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:28:59 user nova-compute[74295]:     <video>
Oct 26 06:28:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:28:59 user nova-compute[74295]:     </video>
Oct 26 06:28:59 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:28:59 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:28:59 user nova-compute[74295]:     </rng>
Oct 26 06:28:59 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:28:59 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:28:59 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:28:59 user nova-compute[74295]:     </memballoon>
Oct 26 06:28:59 user nova-compute[74295]:   </devices>
Oct 26 06:28:59 user nova-compute[74295]: </domain>
Oct 26 06:28:59 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:72:02,bridge_name='br-int',has_traffic_filtering=True,id=41528c15-0199-45b8-a577-d8c4bd0ecb82,network=Network(01ec9754-956c-4aa5-b9d1-9daa78e8679f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41528c15-01') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:72:02,bridge_name='br-int',has_traffic_filtering=True,id=41528c15-0199-45b8-a577-d8c4bd0ecb82,network=Network(01ec9754-956c-4aa5-b9d1-9daa78e8679f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41528c15-01') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '648f5076-4154-5681-9266-850a546c38e5', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41528c15-01, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41528c15-01, col_values=(('qos', UUID('c1f73def-0a30-459f-94eb-94a90eea19af')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41528c15-01, col_values=(('external_ids', {'iface-id': '41528c15-0199-45b8-a577-d8c4bd0ecb82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:72:02', 'vm-uuid': 'a779935e-152e-4223-9a6a-166c9efc490a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: INFO os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:72:02,bridge_name='br-int',has_traffic_filtering=True,id=41528c15-0199-45b8-a577-d8c4bd0ecb82,network=Network(01ec9754-956c-4aa5-b9d1-9daa78e8679f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41528c15-01')
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:68:a4,bridge_name='br-int',has_traffic_filtering=True,id=83f63ce6-41bd-4816-b219-ea48b2f8d979,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83f63ce6-41') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:68:a4,bridge_name='br-int',has_traffic_filtering=True,id=83f63ce6-41bd-4816-b219-ea48b2f8d979,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83f63ce6-41') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77aefb9a-d08f-5ab5-a2de-b1437e3f5957', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83f63ce6-41, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83f63ce6-41, col_values=(('qos', UUID('18a54d51-9f24-410a-996a-ba00b8fa1a19')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83f63ce6-41, col_values=(('external_ids', {'iface-id': '83f63ce6-41bd-4816-b219-ea48b2f8d979', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:68:a4', 'vm-uuid': 'a779935e-152e-4223-9a6a-166c9efc490a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: INFO os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:68:a4,bridge_name='br-int',has_traffic_filtering=True,id=83f63ce6-41bd-4816-b219-ea48b2f8d979,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83f63ce6-41')
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8a:76,bridge_name='br-int',has_traffic_filtering=True,id=eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb14b7e5-90') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8a:76,bridge_name='br-int',has_traffic_filtering=True,id=eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb14b7e5-90') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '967c5420-947f-5e91-a36d-4d5484314c7e', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb14b7e5-90, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb14b7e5-90, col_values=(('qos', UUID('4d7639dd-cd63-4a17-af59-949fd88a2925')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb14b7e5-90, col_values=(('external_ids', {'iface-id': 'eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:8a:76', 'vm-uuid': 'a779935e-152e-4223-9a6a-166c9efc490a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: INFO os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8a:76,bridge_name='br-int',has_traffic_filtering=True,id=eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb14b7e5-90')
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=63f85a57-2470-4601-bc41-05916fda216e,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f85a57-24') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=63f85a57-2470-4601-bc41-05916fda216e,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f85a57-24') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c700b9f-fd62-53d8-9f8e-972b010447ff', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63f85a57-24, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63f85a57-24, col_values=(('qos', UUID('b695b4bd-84b7-4cba-b1f4-6dedb1b0ccd4')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:28:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63f85a57-24, col_values=(('external_ids', {'iface-id': '63f85a57-2470-4601-bc41-05916fda216e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:ca:d5', 'vm-uuid': 'a779935e-152e-4223-9a6a-166c9efc490a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: INFO os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=63f85a57-2470-4601-bc41-05916fda216e,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f85a57-24')
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:34,bridge_name='br-int',has_traffic_filtering=True,id=38bb9e9c-3925-4527-8232-38b330b64587,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bb9e9c-39') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:34,bridge_name='br-int',has_traffic_filtering=True,id=38bb9e9c-3925-4527-8232-38b330b64587,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bb9e9c-39') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3aaff90-c5a7-5674-be99-d1ea876d9957', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38bb9e9c-39, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38bb9e9c-39, col_values=(('qos', UUID('beb56c5c-b009-4062-9035-47d09bf6d8a3')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38bb9e9c-39, col_values=(('external_ids', {'iface-id': '38bb9e9c-3925-4527-8232-38b330b64587', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:98:34', 'vm-uuid': 'a779935e-152e-4223-9a6a-166c9efc490a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: INFO os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:34,bridge_name='br-int',has_traffic_filtering=True,id=38bb9e9c-3925-4527-8232-38b330b64587,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bb9e9c-39')
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:d1:64,bridge_name='br-int',has_traffic_filtering=True,id=c8c86686-cf6b-46b0-a433-e095f5ce79d7,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8c86686-cf') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d1:64,bridge_name='br-int',has_traffic_filtering=True,id=c8c86686-cf6b-46b0-a433-e095f5ce79d7,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8c86686-cf') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8dd99852-5d07-56d4-a64d-a76c02a737db', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8c86686-cf, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8c86686-cf, col_values=(('qos', UUID('3a7c4b15-2601-4a85-a0a0-5723e5f638a8')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8c86686-cf, col_values=(('external_ids', {'iface-id': 'c8c86686-cf6b-46b0-a433-e095f5ce79d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:d1:64', 'vm-uuid': 'a779935e-152e-4223-9a6a-166c9efc490a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: INFO os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d1:64,bridge_name='br-int',has_traffic_filtering=True,id=c8c86686-cf6b-46b0-a433-e095f5ce79d7,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8c86686-cf')
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:e1,bridge_name='br-int',has_traffic_filtering=True,id=32c78116-87ad-4c2a-82bf-c9a044bbd42c,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c78116-87') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:e1,bridge_name='br-int',has_traffic_filtering=True,id=32c78116-87ad-4c2a-82bf-c9a044bbd42c,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c78116-87') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf26fb66-f35c-51b8-9274-940b33097bc9', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c78116-87, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32c78116-87, col_values=(('qos', UUID('737692d5-da7c-470a-a074-c2f4fc11cdd8')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32c78116-87, col_values=(('external_ids', {'iface-id': '32c78116-87ad-4c2a-82bf-c9a044bbd42c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:04:e1', 'vm-uuid': 'a779935e-152e-4223-9a6a-166c9efc490a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:00 user nova-compute[74295]: INFO os_vif [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:e1,bridge_name='br-int',has_traffic_filtering=True,id=32c78116-87ad-4c2a-82bf-c9a044bbd42c,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c78116-87')
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] No BDM found with device name hda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] No VIF found with MAC fa:16:3e:4c:72:02, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] No VIF found with MAC fa:16:3e:23:98:34, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:29:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Using config drive
Oct 26 06:29:00 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:29:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Creating config drive at /opt/stack/data/nova/instances/a779935e-152e-4223-9a6a-166c9efc490a/disk.config
Oct 26 06:29:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a779935e-152e-4223-9a6a-166c9efc490a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppycck56z {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a779935e-152e-4223-9a6a-166c9efc490a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppycck56z" returned: 0 in 0.066s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:01 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:29:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:29:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:29:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:29:01 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updating instance_info_cache with network_info: [{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-ab565e00-d3f4-4454-bd4f-926756a4cb95 req-cce13ce8-3d3d-40fd-a43a-a7d28d65bc79 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ab565e00-d3f4-4454-bd4f-926756a4cb95 req-cce13ce8-3d3d-40fd-a43a-a7d28d65bc79 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ab565e00-d3f4-4454-bd4f-926756a4cb95 req-cce13ce8-3d3d-40fd-a43a-a7d28d65bc79 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ab565e00-d3f4-4454-bd4f-926756a4cb95 req-cce13ce8-3d3d-40fd-a43a-a7d28d65bc79 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-ab565e00-d3f4-4454-bd4f-926756a4cb95 req-cce13ce8-3d3d-40fd-a43a-a7d28d65bc79 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:02 user nova-compute[74295]: WARNING nova.compute.manager [req-ab565e00-d3f4-4454-bd4f-926756a4cb95 req-cce13ce8-3d3d-40fd-a43a-a7d28d65bc79 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 for instance with vm_state building and task_state spawning.
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-7b20ee22-9665-489b-bfcd-64680b80e574 req-ef76bea9-6c4f-42bf-9109-04d77b406cc6 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7b20ee22-9665-489b-bfcd-64680b80e574 req-ef76bea9-6c4f-42bf-9109-04d77b406cc6 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7b20ee22-9665-489b-bfcd-64680b80e574 req-ef76bea9-6c4f-42bf-9109-04d77b406cc6 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7b20ee22-9665-489b-bfcd-64680b80e574 req-ef76bea9-6c4f-42bf-9109-04d77b406cc6 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-7b20ee22-9665-489b-bfcd-64680b80e574 req-ef76bea9-6c4f-42bf-9109-04d77b406cc6 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:02 user nova-compute[74295]: WARNING nova.compute.manager [req-7b20ee22-9665-489b-bfcd-64680b80e574 req-ef76bea9-6c4f-42bf-9109-04d77b406cc6 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 for instance with vm_state building and task_state spawning.
Oct 26 06:29:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-cf6760b1-f32a-4a84-8562-69e6a97ae989 req-3bf792e4-5ffc-42f9-8826-07dd51abd156 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cf6760b1-f32a-4a84-8562-69e6a97ae989 req-3bf792e4-5ffc-42f9-8826-07dd51abd156 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cf6760b1-f32a-4a84-8562-69e6a97ae989 req-3bf792e4-5ffc-42f9-8826-07dd51abd156 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cf6760b1-f32a-4a84-8562-69e6a97ae989 req-3bf792e4-5ffc-42f9-8826-07dd51abd156 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-cf6760b1-f32a-4a84-8562-69e6a97ae989 req-3bf792e4-5ffc-42f9-8826-07dd51abd156 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:03 user nova-compute[74295]: WARNING nova.compute.manager [req-cf6760b1-f32a-4a84-8562-69e6a97ae989 req-3bf792e4-5ffc-42f9-8826-07dd51abd156 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-63f85a57-2470-4601-bc41-05916fda216e for instance with vm_state building and task_state spawning.
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b9e3bf9-9df7-4dad-9a51-6a2ca2adff1e req-f0cfe24e-f4be-43a8-bcb7-093703313991 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b9e3bf9-9df7-4dad-9a51-6a2ca2adff1e req-f0cfe24e-f4be-43a8-bcb7-093703313991 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b9e3bf9-9df7-4dad-9a51-6a2ca2adff1e req-f0cfe24e-f4be-43a8-bcb7-093703313991 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b9e3bf9-9df7-4dad-9a51-6a2ca2adff1e req-f0cfe24e-f4be-43a8-bcb7-093703313991 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b9e3bf9-9df7-4dad-9a51-6a2ca2adff1e req-f0cfe24e-f4be-43a8-bcb7-093703313991 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:04 user nova-compute[74295]: WARNING nova.compute.manager [req-9b9e3bf9-9df7-4dad-9a51-6a2ca2adff1e req-f0cfe24e-f4be-43a8-bcb7-093703313991 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 for instance with vm_state building and task_state spawning.
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:04 user nova-compute[74295]: WARNING nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 for instance with vm_state building and task_state spawning.
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:04 user nova-compute[74295]: WARNING nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b for instance with vm_state building and task_state spawning.
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:04 user nova-compute[74295]: WARNING nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b for instance with vm_state building and task_state spawning.
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:04 user nova-compute[74295]: WARNING nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c for instance with vm_state building and task_state spawning.
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:04 user nova-compute[74295]: WARNING nova.compute.manager [req-f9a129a3-6605-498d-8391-083964f6df5f req-87c46dbf-301d-4f5c-b51a-52c70741a3fb service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c for instance with vm_state building and task_state spawning.
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:05 user nova-compute[74295]: WARNING nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-63f85a57-2470-4601-bc41-05916fda216e for instance with vm_state building and task_state spawning.
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:05 user nova-compute[74295]: WARNING nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-38bb9e9c-3925-4527-8232-38b330b64587 for instance with vm_state building and task_state spawning.
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:05 user nova-compute[74295]: WARNING nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-38bb9e9c-3925-4527-8232-38b330b64587 for instance with vm_state building and task_state spawning.
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:05 user nova-compute[74295]: WARNING nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 for instance with vm_state building and task_state spawning.
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:05 user nova-compute[74295]: WARNING nova.compute.manager [req-2d8d4e7c-6326-4f7d-9f8f-32239853c7a9 req-f27ba36d-9d94-4db5-8494-46516a003026 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 for instance with vm_state building and task_state spawning.
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:29:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance spawned successfully.
Oct 26 06:29:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:29:07 user nova-compute[74295]: INFO nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Took 11.53 seconds to spawn the instance on the hypervisor.
Oct 26 06:29:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:29:07 user nova-compute[74295]: INFO nova.compute.claims [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Claim successful on node user
Oct 26 06:29:07 user nova-compute[74295]: INFO nova.compute.manager [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Took 78.67 seconds to build instance.
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d0436c7-4317-4ae7-932c-98887c8f162b tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "a779935e-152e-4223-9a6a-166c9efc490a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 78.818s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:29:07 user nova-compute[74295]: DEBUG nova.network.neutron [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:29:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:29:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG nova.policy [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '969b88effa7b4c14a9fdca34760804e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac89a741e94482bf18b56aca6a53c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: INFO nova.virt.block_device [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Booting with blank volume at /dev/vda
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smiLEZPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:29:08 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:08 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:08 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b88bfcc-2d6f-4b41-8a53-96dda0bb07a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:29:08 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca02457-9801-4d85-94d5-be9633202a74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361] added
Oct 26 06:29:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcebaa2-2539-4ea6-9150-bafc68256449]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdf9e05-a9f2-4a28-a6e3-b1c8f713e14e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smiLEZPf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smiLEZPf" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e67c1bc-c8c3-4bb8-97fd-6fb68ec65524]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'smiLEZPf'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b13bba-0b72-4598-8a5d-0b0c27e3d713]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfed42b6-bacc-4f3d-834a-9f791e465b1b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Successfully created port: 985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa0f60e-4ab9-4a79-a321-8c04adc90d6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361, portal: 172.16.0.220,3260]
Oct 26 06:29:08 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361, portal: 172.16.0.220,3260] successful.
Oct 26 06:29:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c65545c-cabd-4516-a27f-50a133968dd4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e8145-4bab-48d4-a3b4-ad93eaaafca1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c9253f-b575-411e-bac6-23ab59a604b1]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smiLEZPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivqYMEQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:29:08 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG nova.network.neutron [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Successfully updated port: 985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquired lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG nova.network.neutron [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-88814d3e-173b-4214-8b2e-dd6abf90fbe7 req-8b47168a-98b4-4448-9aa8-2c9537aec51d service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-changed-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-88814d3e-173b-4214-8b2e-dd6abf90fbe7 req-8b47168a-98b4-4448-9aa8-2c9537aec51d service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Refreshing instance network info cache due to event network-changed-985646da-fc56-4732-901c-7d0dfd148f33. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88814d3e-173b-4214-8b2e-dd6abf90fbe7 req-8b47168a-98b4-4448-9aa8-2c9537aec51d service nova] Acquiring lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG nova.network.neutron [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:29:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.775s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] <== connect_volume: return (1780ms) {'type': 'block', 'scsi_wwn': '23532636365666264', 'path': '/dev/sdg'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532636365666264', 'path': '/dev/sdg'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.273s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:10 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:10 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:29:10 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7280MB free_disk=25.481536865234375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.objects.instance [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lazy-loading 'flavor' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4221edc-8cfa-4804-be63-022db54a0354]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:29:10 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:29:10 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:29:10 user nova-compute[74295]:   <source dev="/dev/sdg"/>
Oct 26 06:29:10 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:29:10 user nova-compute[74295]:   <serial>c1f94a2f-06d3-4ade-ba69-fee194916361</serial>
Oct 26 06:29:10 user nova-compute[74295]: </disk>
Oct 26 06:29:10 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6cae65-3cfa-4bae-aa28-d5d18bdf0a63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514] added
Oct 26 06:29:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd744c34-cb9d-4d99-8209-1f9da3403560]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updating instance_info_cache with network_info: [{"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb7c357-d0dd-44cb-a13d-044cc714190d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Releasing lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Instance network_info: |[{"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88814d3e-173b-4214-8b2e-dd6abf90fbe7 req-8b47168a-98b4-4448-9aa8-2c9537aec51d service nova] Acquired lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.network.neutron [req-88814d3e-173b-4214-8b2e-dd6abf90fbe7 req-8b47168a-98b4-4448-9aa8-2c9537aec51d service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Refreshing network info cache for port 985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivqYMEQZ {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivqYMEQZ" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59db4b9-475c-4139-bab0-ced03751cd34]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ivqYMEQZ'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb81abe7-923c-45f9-a855-91ec080bcb6d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 46e224d1-67ea-4449-8952-4554bb302d98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 88335730-9d04-4614-8c24-f0c3957418f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance e86416be-82cc-4ab5-9d48-2173ea952bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a779935e-152e-4223-9a6a-166c9efc490a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[907773a8-31d2-4fc4-a7d0-62ec08843a6f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfcbcea-eb33-40f0-9fd0-8f3a93c2cc41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514, portal: 172.16.0.220,3260]
Oct 26 06:29:10 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514, portal: 172.16.0.220,3260] successful.
Oct 26 06:29:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33bb5f4-281b-4ddc-a5c0-0c742d5af0ac]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be08eba-4db5-44a1-8b78-1a91c54adfff]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5adcf8-ea5d-4e12-ae37-f9eedb35e9d5]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivqYMEQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] No BDM found with device name hda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] No VIF found with MAC fa:16:3e:60:fd:c1, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.network.neutron [req-88814d3e-173b-4214-8b2e-dd6abf90fbe7 req-8b47168a-98b4-4448-9aa8-2c9537aec51d service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updated VIF entry in instance network info cache for port 985646da-fc56-4732-901c-7d0dfd148f33. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.network.neutron [req-88814d3e-173b-4214-8b2e-dd6abf90fbe7 req-8b47168a-98b4-4448-9aa8-2c9537aec51d service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updating instance_info_cache with network_info: [{"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.790s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88814d3e-173b-4214-8b2e-dd6abf90fbe7 req-8b47168a-98b4-4448-9aa8-2c9537aec51d service nova] Releasing lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:29:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-643cc22d-4392-4089-a1a7-6fe592bf21fd tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.607s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] <== connect_volume: return (2749ms) {'type': 'block', 'scsi_wwn': '23332663661633164', 'path': '/dev/sdh'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:29:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332663661633164', 'path': '/dev/sdh'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:29:11 user nova-compute[74295]: DEBUG nova.objects.instance [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lazy-loading 'flavor' on Instance uuid e86416be-82cc-4ab5-9d48-2173ea952bce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] attach device xml: <disk type="block" device="disk">
Oct 26 06:29:11 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:29:11 user nova-compute[74295]:   <source dev="/dev/sdh"/>
Oct 26 06:29:11 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:29:11 user nova-compute[74295]:   <serial>32383492-4c08-4b85-b1df-17387f582514</serial>
Oct 26 06:29:11 user nova-compute[74295]: </disk>
Oct 26 06:29:11 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:29:11 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:29:11 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:29:11 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:29:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:29:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:29:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] No VIF found with MAC fa:16:3e:90:90:2d, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:29:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ac98cac4-1670-4f0f-9a7f-c47d79485941 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.844s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:12 user nova-compute[74295]: INFO nova.compute.manager [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Detaching volume c1f94a2f-06d3-4ade-ba69-fee194916361
Oct 26 06:29:12 user nova-compute[74295]: INFO nova.virt.block_device [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Attempting to driver detach volume c1f94a2f-06d3-4ade-ba69-fee194916361 from mountpoint /dev/vdb
Oct 26 06:29:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Attempting to detach device vdb from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:29:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:29:12 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:29:12 user nova-compute[74295]:   <source dev="/dev/sdg"/>
Oct 26 06:29:12 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:29:12 user nova-compute[74295]:   <serial>c1f94a2f-06d3-4ade-ba69-fee194916361</serial>
Oct 26 06:29:12 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 06:29:12 user nova-compute[74295]: </disk>
Oct 26 06:29:12 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:29:12 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Successfully detached device vdb from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 from the persistent domain config.
Oct 26 06:29:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:29:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:29:12 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:29:12 user nova-compute[74295]:   <source dev="/dev/sdg"/>
Oct 26 06:29:12 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:29:12 user nova-compute[74295]:   <serial>c1f94a2f-06d3-4ade-ba69-fee194916361</serial>
Oct 26 06:29:12 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 06:29:12 user nova-compute[74295]: </disk>
Oct 26 06:29:12 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:29:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d5fdda70-ea8c-41e3-81bd-40542d81a4e1 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] volume_snapshot_create: create_info: {'snapshot_id': '964acd10-3007-442a-b66e-a5c385d9725d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74295) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 26 06:29:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d5fdda70-ea8c-41e3-81bd-40542d81a4e1 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] snap xml: <domainsnapshot>
Oct 26 06:29:13 user nova-compute[74295]:   <disks>
Oct 26 06:29:13 user nova-compute[74295]:     <disk name="/dev/sdh" snapshot="external" type="file">
Oct 26 06:29:13 user nova-compute[74295]:       <source file="/dev/new_file"/>
Oct 26 06:29:13 user nova-compute[74295]:     </disk>
Oct 26 06:29:13 user nova-compute[74295]:     <disk name="vda" snapshot="no"/>
Oct 26 06:29:13 user nova-compute[74295]:   </disks>
Oct 26 06:29:13 user nova-compute[74295]: </domainsnapshot>
Oct 26 06:29:13 user nova-compute[74295]:  {{(pid=74295) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 26 06:29:13 user nova-compute[74295]: DEBUG nova.objects.instance [None req-d5fdda70-ea8c-41e3-81bd-40542d81a4e1 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] Lazy-loading 'system_metadata' on Instance uuid e86416be-82cc-4ab5-9d48-2173ea952bce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-d5fdda70-ea8c-41e3-81bd-40542d81a4e1 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 06:29:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-25df228d-0bbf-44b3-845b-f20fbe8b8087 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] volume_snapshot_delete: delete_info: {'volume_id': '32383492-4c08-4b85-b1df-17387f582514'} {{(pid=74295) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [None req-25df228d-0bbf-44b3-845b-f20fbe8b8087 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     if delete_info['type'] != 'qcow2':
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] KeyError: 'type'
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [None req-d5fdda70-ea8c-41e3-81bd-40542d81a4e1 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     rv = execute(f, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     six.reraise(c, e, tb)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     raise value
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     rv = meth(*args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [None req-d5fdda70-ea8c-41e3-81bd-40542d81a4e1 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     self._volume_snapshot_create(context, instance, guest,
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     rv = execute(f, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     six.reraise(c, e, tb)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     raise value
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     rv = meth(*args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] 
Oct 26 06:29:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [None req-25df228d-0bbf-44b3-845b-f20fbe8b8087 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-cbaa4331-acdf-48c6-b4c0-d8fbde867a35)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server [None req-25df228d-0bbf-44b3-845b-f20fbe8b8087 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] Exception during message handling: KeyError: 'type'
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver [None req-d5fdda70-ea8c-41e3-81bd-40542d81a4e1 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 964acd10-3007-442a-b66e-a5c385d9725d could not be found.
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     raise value
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 964acd10-3007-442a-b66e-a5c385d9725d could not be found. (HTTP 404) (Request-ID: req-8032e5a5-986b-4416-af46-bcb3880b80a1)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 964acd10-3007-442a-b66e-a5c385d9725d could not be found.
Oct 26 06:29:13 user nova-compute[74295]: ERROR nova.virt.libvirt.driver 
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server [None req-d5fdda70-ea8c-41e3-81bd-40542d81a4e1 tempest-VolumesAssistedSnapshotsTest-1412498792 tempest-VolumesAssistedSnapshotsTest-1412498792-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise value
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 06:29:13 user nova-compute[74295]: ERROR oslo_messaging.rpc.server 
Oct 26 06:29:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:13 user nova-compute[74295]: INFO nova.compute.manager [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Detaching volume 32383492-4c08-4b85-b1df-17387f582514
Oct 26 06:29:13 user nova-compute[74295]: INFO nova.virt.block_device [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Attempting to driver detach volume 32383492-4c08-4b85-b1df-17387f582514 from mountpoint /dev/vdb
Oct 26 06:29:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Attempting to detach device vdb from instance e86416be-82cc-4ab5-9d48-2173ea952bce from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:29:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 06:29:13 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:29:13 user nova-compute[74295]:   <source dev="/dev/sdh"/>
Oct 26 06:29:13 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:29:13 user nova-compute[74295]:   <serial>32383492-4c08-4b85-b1df-17387f582514</serial>
Oct 26 06:29:13 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:29:13 user nova-compute[74295]: </disk>
Oct 26 06:29:13 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:29:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Successfully detached device vdb from instance e86416be-82cc-4ab5-9d48-2173ea952bce from the persistent domain config.
Oct 26 06:29:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e86416be-82cc-4ab5-9d48-2173ea952bce from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:29:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 06:29:13 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:29:13 user nova-compute[74295]:   <source dev="/dev/sdh"/>
Oct 26 06:29:13 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:29:13 user nova-compute[74295]:   <serial>32383492-4c08-4b85-b1df-17387f582514</serial>
Oct 26 06:29:13 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:29:13 user nova-compute[74295]: </disk>
Oct 26 06:29:13 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:29:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e86416be-82cc-4ab5-9d48-2173ea952bce {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:29:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:16 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 46e224d1-67ea-4449-8952-4554bb302d98 is timed out.
Oct 26 06:29:16 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Successfully detached device sdc from instance 46e224d1-67ea-4449-8952-4554bb302d98 from the live domain config.
Oct 26 06:29:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrwVOEUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:29:16 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[714e76e6-cb56-421e-9b19-6d6ba02d044c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:29:16 user nova-compute[74295]: No targets found.
Oct 26 06:29:16 user nova-compute[74295]: iSNS:
Oct 26 06:29:16 user nova-compute[74295]: No targets found.
Oct 26 06:29:16 user nova-compute[74295]: STATIC:
Oct 26 06:29:16 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77
Oct 26 06:29:16 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:16 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:16 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150
Oct 26 06:29:16 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:16 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:16 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b
Oct 26 06:29:16 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:16 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:16 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd
Oct 26 06:29:16 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:16 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:16 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514
Oct 26 06:29:16 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:16 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:16 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361
Oct 26 06:29:16 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:16 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:16 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65
Oct 26 06:29:16 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:16 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:16 user nova-compute[74295]: FIRMWARE:
Oct 26 06:29:16 user nova-compute[74295]: No targets found.
Oct 26 06:29:16 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:29:16 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:29:16 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef1276d-8220-41c8-a53c-812c1ec709a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[751ba1e6-6ffd-422f-8c70-b375036572d9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:16 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac25caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91b4f7f-d279-4b53-b34a-350a9ee8ae6a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93f788e-5ac6-45f4-a2e8-998acfffc458]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd18e2-a52f-4fc3-a1ec-d74d6fe6f126]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca56a051-c5e5-4580-8900-9531ebef6432]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fc73bf-7d85-4b33-9f7c-ec8231fb60d4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d2fb39-0ca2-4425-8f94-429b6a9ccaf5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd, portal: 172.16.0.220,3260]
Oct 26 06:29:16 user nova-compute[74295]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd, portal: 172.16.0.220,3260] successful.
Oct 26 06:29:16 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92f82807-b5b8-4bee-8219-8a56a11daefd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e9df41-b3c6-4f78-9a58-a8ffa320e9b8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] <== disconnect_volume: return (354ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:29:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:29:17 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88335730-9d04-4614-8c24-f0c3957418f2 is timed out.
Oct 26 06:29:17 user nova-compute[74295]: DEBUG nova.objects.instance [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lazy-loading 'flavor' on Instance uuid 46e224d1-67ea-4449-8952-4554bb302d98 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:17 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Successfully detached device vdb from instance 88335730-9d04-4614-8c24-f0c3957418f2 from the live domain config.
Oct 26 06:29:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrtbBNeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:29:17 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad407bb-08c7-46e6-837e-237fe022c0d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:29:17 user nova-compute[74295]: No targets found.
Oct 26 06:29:17 user nova-compute[74295]: iSNS:
Oct 26 06:29:17 user nova-compute[74295]: No targets found.
Oct 26 06:29:17 user nova-compute[74295]: STATIC:
Oct 26 06:29:17 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77
Oct 26 06:29:17 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:17 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:17 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150
Oct 26 06:29:17 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:17 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:17 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b
Oct 26 06:29:17 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:17 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:17 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514
Oct 26 06:29:17 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:17 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:17 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361
Oct 26 06:29:17 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:17 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:17 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65
Oct 26 06:29:17 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:17 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:17 user nova-compute[74295]: FIRMWARE:
Oct 26 06:29:17 user nova-compute[74295]: No targets found.
Oct 26 06:29:17 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:29:17 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:29:17 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-816a4106-6c11-426c-ad41-ffbe638f8552 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.925s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e08164-21a2-479f-b181-e627728766be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d83e38-87b8-4ba0-baca-ffac1f8c14ee]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:17 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac658430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:29:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d35b17-8549-47a6-9f57-4cd9f7e98726]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[51659967-d206-4fbe-98da-01001f92ee08]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb5f846-9217-4e33-ba44-52ad72665f6d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c47cd5-c5a1-4c4e-835b-aa7d1e3a88f0]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[56184a86-ec6c-4b9c-8df0-dca0c5f0cadf]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ba622b-a287-4726-b12e-a89e8cbf03bc]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65, portal: 172.16.0.220,3260]
Oct 26 06:29:18 user nova-compute[74295]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65, portal: 172.16.0.220,3260] successful.
Oct 26 06:29:18 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd3e5ca-f997-4202-9616-71ebe315fb65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cea0016-79a0-4c51-a8d8-fbc99b6790a8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] <== disconnect_volume: return (346ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.utils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[af94e8ec-deb4-4d70-b928-28273bb37de7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[243cbec5-9480-4743-9a02-82ed6199cccc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab36199d-3ce9-46ee-a22d-9fdbe4488cd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88dcc56-58a4-40a7-9862-8019b6a1d6ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:29:18 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:29:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba9d11c-61da-40ee-a3cc-fa2c04cc200b]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG os_brick.utils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updating existing volume attachment record: 37f9f37d-7748-4da9-bb1d-52f663f2cb23 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lazy-loading 'flavor' on Instance uuid 88335730-9d04-4614-8c24-f0c3957418f2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6861a8c7-3f50-4273-b136-7e6ab53422a6 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.106s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:19 user nova-compute[74295]: INFO nova.compute.manager [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Terminating instance
Oct 26 06:29:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-803202f5-2273-4bc9-aa24-e6652af04f92 req-f6c5bdcc-fcf3-40c2-8881-4dbfdca46e5c service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received event network-vif-unplugged-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-803202f5-2273-4bc9-aa24-e6652af04f92 req-f6c5bdcc-fcf3-40c2-8881-4dbfdca46e5c service nova] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-803202f5-2273-4bc9-aa24-e6652af04f92 req-f6c5bdcc-fcf3-40c2-8881-4dbfdca46e5c service nova] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-803202f5-2273-4bc9-aa24-e6652af04f92 req-f6c5bdcc-fcf3-40c2-8881-4dbfdca46e5c service nova] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-803202f5-2273-4bc9-aa24-e6652af04f92 req-f6c5bdcc-fcf3-40c2-8881-4dbfdca46e5c service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] No waiting events found dispatching network-vif-unplugged-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-803202f5-2273-4bc9-aa24-e6652af04f92 req-f6c5bdcc-fcf3-40c2-8881-4dbfdca46e5c service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received event network-vif-unplugged-f90efd59-670f-4d95-9434-a9cbaf114f1d for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:29:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Instance destroyed successfully.
Oct 26 06:29:20 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lazy-loading 'resources' on Instance uuid 46e224d1-67ea-4449-8952-4554bb302d98 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-435418608',display_name='tempest-AttachSCSIVolumeTestJSON-server-435418608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-435418608',id=7,image_ref='2e535bcc-c838-4318-a22f-4ce6935ae7ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5P5cH9C1MwdPpbHO2TImsXeJFnRWY2M8HQLmKDjuSvCAXf4zdE4WTAegP++VWU8i7Bs5+eidcU9EH4KKjPTEag4PhLiSlPTwuOGur9RZpQUKbXK/n+J8XjtlLdIs7ylg==',key_name='tempest-keypair-720622320',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbabe75d3ef74e7392fdb286d76a0c5b',ramdisk_id='',reservation_id='r-q14f8qem',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2e535bcc-c838-4318-a22f-4ce6935ae7ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-309639301',owner_user_name='tempest-AttachSCSIVolumeTestJSON-309639301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46038c5dea054670abdc18796ab34513',uuid=46e224d1-67ea-4449-8952-4554bb302d98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Converting VIF {"id": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "address": "fa:16:3e:bb:e0:25", "network": {"id": "0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1877804843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbabe75d3ef74e7392fdb286d76a0c5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90efd59-67", "ovs_interfaceid": "f90efd59-670f-4d95-9434-a9cbaf114f1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:e0:25,bridge_name='br-int',has_traffic_filtering=True,id=f90efd59-670f-4d95-9434-a9cbaf114f1d,network=Network(0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90efd59-67') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG os_vif [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:e0:25,bridge_name='br-int',has_traffic_filtering=True,id=f90efd59-670f-4d95-9434-a9cbaf114f1d,network=Network(0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90efd59-67') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf90efd59-67, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0040a38-0031-4c2b-b781-95db9e71e011) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:20 user nova-compute[74295]: INFO os_vif [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:e0:25,bridge_name='br-int',has_traffic_filtering=True,id=f90efd59-670f-4d95-9434-a9cbaf114f1d,network=Network(0b3f7c7d-6db0-46c2-a4e4-ebb6a7844649),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90efd59-67')
Oct 26 06:29:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Deleting instance files /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98_del
Oct 26 06:29:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Deletion of /opt/stack/data/nova/instances/46e224d1-67ea-4449-8952-4554bb302d98_del complete
Oct 26 06:29:20 user nova-compute[74295]: INFO nova.compute.manager [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 06:29:20 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:29:20 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:29:21 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:29:21 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Took 1.23 seconds to deallocate network for instance.
Oct 26 06:29:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-ba002f49-a3fc-4e37-b368-6d94f641385a req-ed220118-87a2-4dca-8086-c0931e85143a service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received event network-vif-plugged-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ba002f49-a3fc-4e37-b368-6d94f641385a req-ed220118-87a2-4dca-8086-c0931e85143a service nova] Acquiring lock "46e224d1-67ea-4449-8952-4554bb302d98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ba002f49-a3fc-4e37-b368-6d94f641385a req-ed220118-87a2-4dca-8086-c0931e85143a service nova] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ba002f49-a3fc-4e37-b368-6d94f641385a req-ed220118-87a2-4dca-8086-c0931e85143a service nova] Lock "46e224d1-67ea-4449-8952-4554bb302d98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-ba002f49-a3fc-4e37-b368-6d94f641385a req-ed220118-87a2-4dca-8086-c0931e85143a service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] No waiting events found dispatching network-vif-plugged-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:21 user nova-compute[74295]: WARNING nova.compute.manager [req-ba002f49-a3fc-4e37-b368-6d94f641385a req-ed220118-87a2-4dca-8086-c0931e85143a service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received unexpected event network-vif-plugged-f90efd59-670f-4d95-9434-a9cbaf114f1d for instance with vm_state deleted and task_state None.
Oct 26 06:29:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-ba002f49-a3fc-4e37-b368-6d94f641385a req-ed220118-87a2-4dca-8086-c0931e85143a service nova] [instance: 46e224d1-67ea-4449-8952-4554bb302d98] Received event network-vif-deleted-f90efd59-670f-4d95-9434-a9cbaf114f1d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:22 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:29:22 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:29:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:22 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Deleted allocations for instance 46e224d1-67ea-4449-8952-4554bb302d98
Oct 26 06:29:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f4813040-4c21-4c2b-af21-ccb4cf13f296 tempest-AttachSCSIVolumeTestJSON-309639301 tempest-AttachSCSIVolumeTestJSON-309639301-project-member] Lock "46e224d1-67ea-4449-8952-4554bb302d98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:33 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 is timed out.
Oct 26 06:29:33 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Successfully detached device vdb from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 from the live domain config.
Oct 26 06:29:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smiLEZPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:29:33 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6084a1-4444-43f6-844c-1e0fa15fccc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:29:33 user nova-compute[74295]: No targets found.
Oct 26 06:29:33 user nova-compute[74295]: iSNS:
Oct 26 06:29:33 user nova-compute[74295]: No targets found.
Oct 26 06:29:33 user nova-compute[74295]: STATIC:
Oct 26 06:29:33 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77
Oct 26 06:29:33 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:33 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:33 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150
Oct 26 06:29:33 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:33 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:33 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b
Oct 26 06:29:33 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:33 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:33 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514
Oct 26 06:29:33 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:33 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:33 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361
Oct 26 06:29:33 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:33 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:33 user nova-compute[74295]: FIRMWARE:
Oct 26 06:29:33 user nova-compute[74295]: No targets found.
Oct 26 06:29:33 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:29:33 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:29:33 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[498a277a-f0b2-4f4c-9ced-476ed32e629e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[688787cd-4060-4174-9f3a-581da727fa32]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:33 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:33 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:33 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:33 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:33 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:33 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:33 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:33 user nova-compute[74295]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 (non-flash)
Oct 26 06:29:33 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:33 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac731990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361'): ({'sdg'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Removing single pathed devices sdg {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdfc1ff-ec5b-48cb-987c-fac28ec46bd7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5eeb81-59b5-4bd6-87ef-9b93f47f0334]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Flushing IO for device /dev/sdg {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc4f53c-fa94-4281-9e1b-1f8d7e67f677]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca31260b-11df-481c-967b-f18f07d56e5b]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] SCSI volumes sdg have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9898ff46-3092-496d-959f-fed423895876]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --logout" returned: 0 in 0.157s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[752acc5a-dab3-4aff-9dfe-3b87a77693b1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361, portal: 172.16.0.220,3260]
Oct 26 06:29:33 user nova-compute[74295]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361, portal: 172.16.0.220,3260] successful.
Oct 26 06:29:33 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f94a2f-06d3-4ade-ba69-fee194916361 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5704c3ed-5d18-4825-80f2-980b3b06f305]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] <== disconnect_volume: return (461ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:29:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:29:34 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e86416be-82cc-4ab5-9d48-2173ea952bce is timed out.
Oct 26 06:29:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Successfully detached device vdb from instance e86416be-82cc-4ab5-9d48-2173ea952bce from the live domain config.
Oct 26 06:29:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivqYMEQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:29:34 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6540af-25ef-4806-b955-4b290e9dd297]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:29:34 user nova-compute[74295]: No targets found.
Oct 26 06:29:34 user nova-compute[74295]: iSNS:
Oct 26 06:29:34 user nova-compute[74295]: No targets found.
Oct 26 06:29:34 user nova-compute[74295]: STATIC:
Oct 26 06:29:34 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77
Oct 26 06:29:34 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:34 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:34 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150
Oct 26 06:29:34 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:34 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:34 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b
Oct 26 06:29:34 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:34 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:34 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514
Oct 26 06:29:34 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:29:34 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:29:34 user nova-compute[74295]: FIRMWARE:
Oct 26 06:29:34 user nova-compute[74295]: No targets found.
Oct 26 06:29:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:29:34 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:29:34 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[189b02ce-5787-44f6-84dc-fe04ae163438]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33fc3d5-2290-4662-8e47-9ed8443d4110]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:34 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:34 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:34 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:34 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:34 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:34 user nova-compute[74295]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 (non-flash)
Oct 26 06:29:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac70e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514'): ({'sdh'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Removing single pathed devices sdh {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5e3145-339d-44ca-b862-3490075b6fd4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd011b8-9ae5-4b2a-97a2-cf47e49eb692]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Flushing IO for device /dev/sdh {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00c789e-ee4e-4f83-88ab-50bf4cfa8d28]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[37662f2a-50f8-4444-8591-f506d1d56c00]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] SCSI volumes sdh have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e470fd14-5752-428a-9e30-3b0239a97bea]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e16594-5fdb-413f-857e-ca8bb03d87f6]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514, portal: 172.16.0.220,3260]
Oct 26 06:29:34 user nova-compute[74295]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514, portal: 172.16.0.220,3260] successful.
Oct 26 06:29:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32383492-4c08-4b85-b1df-17387f582514 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c917e6e6-5316-495e-b518-29b3a19b7b28]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] <== disconnect_volume: return (312ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:29:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:29:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:35 user nova-compute[74295]: DEBUG nova.objects.instance [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lazy-loading 'flavor' on Instance uuid e86416be-82cc-4ab5-9d48-2173ea952bce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-8538e36e-3c24-492e-a947-bd7ae34d0613 tempest-VolumesAssistedSnapshotsTest-394110216 tempest-VolumesAssistedSnapshotsTest-394110216-project-admin] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.228s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:29:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Creating image(s)
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Ensure instance console log exists: /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Start _get_guest_xml network_info=[{"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '37f9f37d-7748-4da9-bb1d-52f663f2cb23', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScNZWuHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '563360ea-d5ca-4006-9c23-3bf9aac300ce', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7ce315e-d746-48e0-ae4d-0bdd50f92066', 'serial': 'c7ce315e-d746-48e0-ae4d-0bdd50f92066'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:29:40 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:29:40 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScNZWuHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:29:40 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:40 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:29:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:29:40 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19402c9-eaa1-4924-91dc-af20d7c027f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:29:40 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6ec794-d8cb-4f99-b2c2-7c7b77f5d9af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066] added
Oct 26 06:29:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0123ecf-c99a-493a-ad9a-9e37d68b4868]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[960193d3-8b82-459a-a711-1692574ecf0f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScNZWuHC {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScNZWuHC" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[32269178-ea32-427d-897b-ced3f4d0504b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScNZWuHC'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad013e9-03d1-478b-8f33-2bd624f24687]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9193bac-20e8-44a8-90a2-550b783b86f9]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[648745e5-8651-4b34-be52-2301e5ca2e17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066, portal: 172.16.0.220,3260]
Oct 26 06:29:41 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066, portal: 172.16.0.220,3260] successful.
Oct 26 06:29:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ccda00-60db-4fac-a053-12b203b3e6ca]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ef966-f5bb-47df-b91e-f8f5bc91facf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:29:41 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:29:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd0e025-81b3-4663-9deb-4aeb8d716878]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:29:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScNZWuHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23835343461623861', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835343461623861', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1188557978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1188557978',id=12,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-gak5wurj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:29:08Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=563360ea-d5ca-4006-9c23-3bf9aac300ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:c8:ae,bridge_name='br-int',has_traffic_filtering=True,id=985646da-fc56-4732-901c-7d0dfd148f33,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985646da-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.objects.instance [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'pci_devices' on Instance uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:29:42 user nova-compute[74295]:   <uuid>563360ea-d5ca-4006-9c23-3bf9aac300ce</uuid>
Oct 26 06:29:42 user nova-compute[74295]:   <name>instance-0000000c</name>
Oct 26 06:29:42 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:29:42 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:29:42 user nova-compute[74295]:   <metadata>
Oct 26 06:29:42 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:29:42 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:29:42 user nova-compute[74295]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1188557978</nova:name>
Oct 26 06:29:42 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:29:40</nova:creationTime>
Oct 26 06:29:42 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:29:42 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:29:42 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:29:42 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:29:42 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:29:42 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:29:42 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:29:42 user nova-compute[74295]:       <nova:owner>
Oct 26 06:29:42 user nova-compute[74295]:         <nova:user uuid="969b88effa7b4c14a9fdca34760804e8">tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member</nova:user>
Oct 26 06:29:42 user nova-compute[74295]:         <nova:project uuid="e0ac89a741e94482bf18b56aca6a53c1">tempest-ServerBootFromVolumeStableRescueTest-1259261992</nova:project>
Oct 26 06:29:42 user nova-compute[74295]:       </nova:owner>
Oct 26 06:29:42 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:29:42 user nova-compute[74295]:       <nova:ports>
Oct 26 06:29:42 user nova-compute[74295]:         <nova:port uuid="985646da-fc56-4732-901c-7d0dfd148f33">
Oct 26 06:29:42 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 06:29:42 user nova-compute[74295]:         </nova:port>
Oct 26 06:29:42 user nova-compute[74295]:       </nova:ports>
Oct 26 06:29:42 user nova-compute[74295]:     </nova:instance>
Oct 26 06:29:42 user nova-compute[74295]:   </metadata>
Oct 26 06:29:42 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:29:42 user nova-compute[74295]:     <system>
Oct 26 06:29:42 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:29:42 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:29:42 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:29:42 user nova-compute[74295]:       <entry name="serial">563360ea-d5ca-4006-9c23-3bf9aac300ce</entry>
Oct 26 06:29:42 user nova-compute[74295]:       <entry name="uuid">563360ea-d5ca-4006-9c23-3bf9aac300ce</entry>
Oct 26 06:29:42 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:29:42 user nova-compute[74295]:     </system>
Oct 26 06:29:42 user nova-compute[74295]:   </sysinfo>
Oct 26 06:29:42 user nova-compute[74295]:   <os>
Oct 26 06:29:42 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:29:42 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:29:42 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:29:42 user nova-compute[74295]:   </os>
Oct 26 06:29:42 user nova-compute[74295]:   <features>
Oct 26 06:29:42 user nova-compute[74295]:     <acpi/>
Oct 26 06:29:42 user nova-compute[74295]:     <apic/>
Oct 26 06:29:42 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:29:42 user nova-compute[74295]:   </features>
Oct 26 06:29:42 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:29:42 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:29:42 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:29:42 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:29:42 user nova-compute[74295]:   </clock>
Oct 26 06:29:42 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:29:42 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:29:42 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:29:42 user nova-compute[74295]:   </cpu>
Oct 26 06:29:42 user nova-compute[74295]:   <devices>
Oct 26 06:29:42 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:29:42 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:29:42 user nova-compute[74295]:       <source dev="/dev/sdb"/>
Oct 26 06:29:42 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:29:42 user nova-compute[74295]:       <serial>c7ce315e-d746-48e0-ae4d-0bdd50f92066</serial>
Oct 26 06:29:42 user nova-compute[74295]:     </disk>
Oct 26 06:29:42 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:29:42 user nova-compute[74295]:       <mac address="fa:16:3e:c8:c8:ae"/>
Oct 26 06:29:42 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:29:42 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:29:42 user nova-compute[74295]:       <target dev="tap985646da-fc"/>
Oct 26 06:29:42 user nova-compute[74295]:     </interface>
Oct 26 06:29:42 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:29:42 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/console.log" append="off"/>
Oct 26 06:29:42 user nova-compute[74295]:     </serial>
Oct 26 06:29:42 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:29:42 user nova-compute[74295]:     <video>
Oct 26 06:29:42 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:29:42 user nova-compute[74295]:     </video>
Oct 26 06:29:42 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:29:42 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:29:42 user nova-compute[74295]:     </rng>
Oct 26 06:29:42 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:29:42 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:29:42 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:29:42 user nova-compute[74295]:     </memballoon>
Oct 26 06:29:42 user nova-compute[74295]:   </devices>
Oct 26 06:29:42 user nova-compute[74295]: </domain>
Oct 26 06:29:42 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1188557978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1188557978',id=12,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-gak5wurj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:29:08Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=563360ea-d5ca-4006-9c23-3bf9aac300ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:c8:ae,bridge_name='br-int',has_traffic_filtering=True,id=985646da-fc56-4732-901c-7d0dfd148f33,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985646da-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG os_vif [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:c8:ae,bridge_name='br-int',has_traffic_filtering=True,id=985646da-fc56-4732-901c-7d0dfd148f33,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985646da-fc') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb2f815d-bf1f-5914-9952-691b6e3191b7', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap985646da-fc, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap985646da-fc, col_values=(('qos', UUID('65f6b3d3-cb4b-4142-b7ff-ca6c9213754d')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap985646da-fc, col_values=(('external_ids', {'iface-id': '985646da-fc56-4732-901c-7d0dfd148f33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:c8:ae', 'vm-uuid': '563360ea-d5ca-4006-9c23-3bf9aac300ce'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:42 user nova-compute[74295]: INFO os_vif [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:c8:ae,bridge_name='br-int',has_traffic_filtering=True,id=985646da-fc56-4732-901c-7d0dfd148f33,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985646da-fc')
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No VIF found with MAC fa:16:3e:c8:c8:ae, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:29:42 user nova-compute[74295]: DEBUG nova.objects.instance [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lazy-loading 'flavor' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0c8083b6-6788-488c-8527-cbd185f8fe09 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.371s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "interface-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-728a6d93-5334-466c-ae8c-42a7b45d7383" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "interface-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-728a6d93-5334-466c-ae8c-42a7b45d7383" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.objects.instance [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lazy-loading 'flavor' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235576379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235576379',id=9,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWyzCZKNfN++RdhZ7vCbqyQNIYdI761TFaG7JRpiZgjn40o6GYxEOHQNTFN5QLWKwFHwjbW8YmEMF7M/0RDutFK5QOejaU2AoitJ/iwiYQOMZr1KHRuqURWMhnnUXc/g==',key_name='tempest-keypair-916215385',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5684b5893b604af484029883dbf5132b',ramdisk_id='',reservation_id='r-oovp6ig1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1270357865',owner_user_name='tempest-TaggedAttachmentsTest-1270357865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='620a58893e6f41a1ae1e57f672427d61',uuid=4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converting VIF {"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface> {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface> {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Attempting to detach device tap728a6d93-53 from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] detach device xml: <interface type="ethernet">
Oct 26 06:29:43 user nova-compute[74295]:   <mac address="fa:16:3e:f6:7f:54"/>
Oct 26 06:29:43 user nova-compute[74295]:   <model type="virtio"/>
Oct 26 06:29:43 user nova-compute[74295]:   <mtu size="1442"/>
Oct 26 06:29:43 user nova-compute[74295]:   <target dev="tap728a6d93-53"/>
Oct 26 06:29:43 user nova-compute[74295]: </interface>
Oct 26 06:29:43 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface> {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 26 06:29:43 user nova-compute[74295]:   <name>instance-00000009</name>
Oct 26 06:29:43 user nova-compute[74295]:   <uuid>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</uuid>
Oct 26 06:29:43 user nova-compute[74295]:   <metadata>
Oct 26 06:29:43 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:29:43 user nova-compute[74295]:   <nova:package version="0.0.0"/>
Oct 26 06:29:43 user nova-compute[74295]:   <nova:name>tempest-device-tagging-server-235576379</nova:name>
Oct 26 06:29:43 user nova-compute[74295]:   <nova:creationTime>2023-10-26 06:28:34</nova:creationTime>
Oct 26 06:29:43 user nova-compute[74295]:   <nova:flavor name="m1.tiny">
Oct 26 06:29:43 user nova-compute[74295]:     <nova:memory>512</nova:memory>
Oct 26 06:29:43 user nova-compute[74295]:     <nova:disk>1</nova:disk>
Oct 26 06:29:43 user nova-compute[74295]:     <nova:swap>0</nova:swap>
Oct 26 06:29:43 user nova-compute[74295]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:29:43 user nova-compute[74295]:     <nova:vcpus>1</nova:vcpus>
Oct 26 06:29:43 user nova-compute[74295]:   </nova:flavor>
Oct 26 06:29:43 user nova-compute[74295]:   <nova:owner>
Oct 26 06:29:43 user nova-compute[74295]:     <nova:user uuid="620a58893e6f41a1ae1e57f672427d61">tempest-TaggedAttachmentsTest-1270357865-project-member</nova:user>
Oct 26 06:29:43 user nova-compute[74295]:     <nova:project uuid="5684b5893b604af484029883dbf5132b">tempest-TaggedAttachmentsTest-1270357865</nova:project>
Oct 26 06:29:43 user nova-compute[74295]:   </nova:owner>
Oct 26 06:29:43 user nova-compute[74295]:   <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:29:43 user nova-compute[74295]:   <nova:ports>
Oct 26 06:29:43 user nova-compute[74295]:     <nova:port uuid="ba4ab381-015f-4485-8618-e7c48a5f0d26">
Oct 26 06:29:43 user nova-compute[74295]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:29:43 user nova-compute[74295]:     </nova:port>
Oct 26 06:29:43 user nova-compute[74295]:     <nova:port uuid="728a6d93-5334-466c-ae8c-42a7b45d7383">
Oct 26 06:29:43 user nova-compute[74295]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Oct 26 06:29:43 user nova-compute[74295]:     </nova:port>
Oct 26 06:29:43 user nova-compute[74295]:   </nova:ports>
Oct 26 06:29:43 user nova-compute[74295]: </nova:instance>
Oct 26 06:29:43 user nova-compute[74295]:   </metadata>
Oct 26 06:29:43 user nova-compute[74295]:   <memory unit='KiB'>524288</memory>
Oct 26 06:29:43 user nova-compute[74295]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 06:29:43 user nova-compute[74295]:   <vcpu placement='static'>1</vcpu>
Oct 26 06:29:43 user nova-compute[74295]:   <resource>
Oct 26 06:29:43 user nova-compute[74295]:     <partition>/machine</partition>
Oct 26 06:29:43 user nova-compute[74295]:   </resource>
Oct 26 06:29:43 user nova-compute[74295]:   <sysinfo type='smbios'>
Oct 26 06:29:43 user nova-compute[74295]:     <system>
Oct 26 06:29:43 user nova-compute[74295]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 06:29:43 user nova-compute[74295]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 06:29:43 user nova-compute[74295]:       <entry name='version'>0.0.0</entry>
Oct 26 06:29:43 user nova-compute[74295]:       <entry name='serial'>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:29:43 user nova-compute[74295]:       <entry name='uuid'>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:29:43 user nova-compute[74295]:       <entry name='family'>Virtual Machine</entry>
Oct 26 06:29:43 user nova-compute[74295]:     </system>
Oct 26 06:29:43 user nova-compute[74295]:   </sysinfo>
Oct 26 06:29:43 user nova-compute[74295]:   <os>
Oct 26 06:29:43 user nova-compute[74295]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 06:29:43 user nova-compute[74295]:     <boot dev='hd'/>
Oct 26 06:29:43 user nova-compute[74295]:     <smbios mode='sysinfo'/>
Oct 26 06:29:43 user nova-compute[74295]:   </os>
Oct 26 06:29:43 user nova-compute[74295]:   <features>
Oct 26 06:29:43 user nova-compute[74295]:     <acpi/>
Oct 26 06:29:43 user nova-compute[74295]:     <apic/>
Oct 26 06:29:43 user nova-compute[74295]:     <vmcoreinfo state='on'/>
Oct 26 06:29:43 user nova-compute[74295]:   </features>
Oct 26 06:29:43 user nova-compute[74295]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 06:29:43 user nova-compute[74295]:     <model fallback='forbid'>Nehalem</model>
Oct 26 06:29:43 user nova-compute[74295]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 06:29:43 user nova-compute[74295]:     <feature policy='require' name='vme'/>
Oct 26 06:29:43 user nova-compute[74295]:     <feature policy='require' name='x2apic'/>
Oct 26 06:29:43 user nova-compute[74295]:     <feature policy='require' name='hypervisor'/>
Oct 26 06:29:43 user nova-compute[74295]:   </cpu>
Oct 26 06:29:43 user nova-compute[74295]:   <clock offset='utc'>
Oct 26 06:29:43 user nova-compute[74295]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 06:29:43 user nova-compute[74295]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 06:29:43 user nova-compute[74295]:     <timer name='hpet' present='no'/>
Oct 26 06:29:43 user nova-compute[74295]:   </clock>
Oct 26 06:29:43 user nova-compute[74295]:   <on_poweroff>destroy</on_poweroff>
Oct 26 06:29:43 user nova-compute[74295]:   <on_reboot>restart</on_reboot>
Oct 26 06:29:43 user nova-compute[74295]:   <on_crash>destroy</on_crash>
Oct 26 06:29:43 user nova-compute[74295]:   <devices>
Oct 26 06:29:43 user nova-compute[74295]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 06:29:43 user nova-compute[74295]:     <disk type='file' device='disk'>
Oct 26 06:29:43 user nova-compute[74295]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 06:29:43 user nova-compute[74295]:       <source file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk' index='2'/>
Oct 26 06:29:43 user nova-compute[74295]:       <backingStore type='file' index='3'>
Oct 26 06:29:43 user nova-compute[74295]:         <format type='raw'/>
Oct 26 06:29:43 user nova-compute[74295]:         <source file='/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799'/>
Oct 26 06:29:43 user nova-compute[74295]:         <backingStore/>
Oct 26 06:29:43 user nova-compute[74295]:       </backingStore>
Oct 26 06:29:43 user nova-compute[74295]:       <target dev='vda' bus='virtio'/>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='virtio-disk0'/>
Oct 26 06:29:43 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </disk>
Oct 26 06:29:43 user nova-compute[74295]:     <disk type='file' device='cdrom'>
Oct 26 06:29:43 user nova-compute[74295]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 06:29:43 user nova-compute[74295]:       <source file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.config' index='1'/>
Oct 26 06:29:43 user nova-compute[74295]:       <backingStore/>
Oct 26 06:29:43 user nova-compute[74295]:       <target dev='hda' bus='ide'/>
Oct 26 06:29:43 user nova-compute[74295]:       <readonly/>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='ide0-0-0'/>
Oct 26 06:29:43 user nova-compute[74295]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </disk>
Oct 26 06:29:43 user nova-compute[74295]:     <controller type='usb' index='0' model='none'>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='usb'/>
Oct 26 06:29:43 user nova-compute[74295]:     </controller>
Oct 26 06:29:43 user nova-compute[74295]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='pci.0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </controller>
Oct 26 06:29:43 user nova-compute[74295]:     <controller type='ide' index='0'>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='ide'/>
Oct 26 06:29:43 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 06:29:43 user nova-compute[74295]:     </controller>
Oct 26 06:29:43 user nova-compute[74295]:     <interface type='ethernet'>
Oct 26 06:29:43 user nova-compute[74295]:       <mac address='fa:16:3e:60:fd:c1'/>
Oct 26 06:29:43 user nova-compute[74295]:       <target dev='tapba4ab381-01'/>
Oct 26 06:29:43 user nova-compute[74295]:       <model type='virtio'/>
Oct 26 06:29:43 user nova-compute[74295]:       <mtu size='1442'/>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='net0'/>
Oct 26 06:29:43 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </interface>
Oct 26 06:29:43 user nova-compute[74295]:     <interface type='ethernet'>
Oct 26 06:29:43 user nova-compute[74295]:       <mac address='fa:16:3e:f6:7f:54'/>
Oct 26 06:29:43 user nova-compute[74295]:       <target dev='tap728a6d93-53'/>
Oct 26 06:29:43 user nova-compute[74295]:       <model type='virtio'/>
Oct 26 06:29:43 user nova-compute[74295]:       <mtu size='1442'/>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='net1'/>
Oct 26 06:29:43 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </interface>
Oct 26 06:29:43 user nova-compute[74295]:     <serial type='pty'>
Oct 26 06:29:43 user nova-compute[74295]:       <source path='/dev/pts/8'/>
Oct 26 06:29:43 user nova-compute[74295]:       <log file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log' append='off'/>
Oct 26 06:29:43 user nova-compute[74295]:       <target type='isa-serial' port='0'>
Oct 26 06:29:43 user nova-compute[74295]:         <model name='isa-serial'/>
Oct 26 06:29:43 user nova-compute[74295]:       </target>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='serial0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </serial>
Oct 26 06:29:43 user nova-compute[74295]:     <console type='pty' tty='/dev/pts/8'>
Oct 26 06:29:43 user nova-compute[74295]:       <source path='/dev/pts/8'/>
Oct 26 06:29:43 user nova-compute[74295]:       <log file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log' append='off'/>
Oct 26 06:29:43 user nova-compute[74295]:       <target type='serial' port='0'/>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='serial0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </console>
Oct 26 06:29:43 user nova-compute[74295]:     <input type='mouse' bus='ps2'>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='input0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </input>
Oct 26 06:29:43 user nova-compute[74295]:     <input type='keyboard' bus='ps2'>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='input1'/>
Oct 26 06:29:43 user nova-compute[74295]:     </input>
Oct 26 06:29:43 user nova-compute[74295]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 26 06:29:43 user nova-compute[74295]:       <listen type='address' address='0.0.0.0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </graphics>
Oct 26 06:29:43 user nova-compute[74295]:     <audio id='1' type='none'/>
Oct 26 06:29:43 user nova-compute[74295]:     <video>
Oct 26 06:29:43 user nova-compute[74295]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='video0'/>
Oct 26 06:29:43 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </video>
Oct 26 06:29:43 user nova-compute[74295]:     <memballoon model='virtio'>
Oct 26 06:29:43 user nova-compute[74295]:       <stats period='10'/>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='balloon0'/>
Oct 26 06:29:43 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </memballoon>
Oct 26 06:29:43 user nova-compute[74295]:     <rng model='virtio'>
Oct 26 06:29:43 user nova-compute[74295]:       <backend model='random'>/dev/urandom</backend>
Oct 26 06:29:43 user nova-compute[74295]:       <alias name='rng0'/>
Oct 26 06:29:43 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 06:29:43 user nova-compute[74295]:     </rng>
Oct 26 06:29:43 user nova-compute[74295]:   </devices>
Oct 26 06:29:43 user nova-compute[74295]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 06:29:43 user nova-compute[74295]:     <label>libvirt-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</label>
Oct 26 06:29:43 user nova-compute[74295]:     <imagelabel>libvirt-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</imagelabel>
Oct 26 06:29:43 user nova-compute[74295]:   </seclabel>
Oct 26 06:29:43 user nova-compute[74295]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 06:29:43 user nova-compute[74295]:     <label>+64055:+108</label>
Oct 26 06:29:43 user nova-compute[74295]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 06:29:43 user nova-compute[74295]:   </seclabel>
Oct 26 06:29:43 user nova-compute[74295]: </domain>
Oct 26 06:29:43 user nova-compute[74295]:  {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 06:29:43 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Successfully detached device tap728a6d93-53 from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 from the persistent domain config.
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] (1/8): Attempting to detach device tap728a6d93-53 with device alias net1 from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] detach device xml: <interface type="ethernet">
Oct 26 06:29:43 user nova-compute[74295]:   <mac address="fa:16:3e:f6:7f:54"/>
Oct 26 06:29:43 user nova-compute[74295]:   <model type="virtio"/>
Oct 26 06:29:43 user nova-compute[74295]:   <mtu size="1442"/>
Oct 26 06:29:43 user nova-compute[74295]:   <target dev="tap728a6d93-53"/>
Oct 26 06:29:43 user nova-compute[74295]: </interface>
Oct 26 06:29:43 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0af905c-5504-4bf6-b7e4-5c222914c7d7 req-c1e76dcd-360f-4340-be82-7636f4a20523 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0af905c-5504-4bf6-b7e4-5c222914c7d7 req-c1e76dcd-360f-4340-be82-7636f4a20523 service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0af905c-5504-4bf6-b7e4-5c222914c7d7 req-c1e76dcd-360f-4340-be82-7636f4a20523 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0af905c-5504-4bf6-b7e4-5c222914c7d7 req-c1e76dcd-360f-4340-be82-7636f4a20523 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0af905c-5504-4bf6-b7e4-5c222914c7d7 req-c1e76dcd-360f-4340-be82-7636f4a20523 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:43 user nova-compute[74295]: WARNING nova.compute.manager [req-a0af905c-5504-4bf6-b7e4-5c222914c7d7 req-c1e76dcd-360f-4340-be82-7636f4a20523 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state building and task_state spawning.
Oct 26 06:29:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Start waiting for the detach event from libvirt for device tap728a6d93-53 with device alias net1 for instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-469894f9-fcad-4d55-b72c-31c0048ef2bc req-2d3bfd78-3428-4c30-81ef-ba548c8267cd service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-unplugged-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-469894f9-fcad-4d55-b72c-31c0048ef2bc req-2d3bfd78-3428-4c30-81ef-ba548c8267cd service nova] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-469894f9-fcad-4d55-b72c-31c0048ef2bc req-2d3bfd78-3428-4c30-81ef-ba548c8267cd service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-469894f9-fcad-4d55-b72c-31c0048ef2bc req-2d3bfd78-3428-4c30-81ef-ba548c8267cd service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-469894f9-fcad-4d55-b72c-31c0048ef2bc req-2d3bfd78-3428-4c30-81ef-ba548c8267cd service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] No waiting events found dispatching network-vif-unplugged-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:44 user nova-compute[74295]: WARNING nova.compute.manager [req-469894f9-fcad-4d55-b72c-31c0048ef2bc req-2d3bfd78-3428-4c30-81ef-ba548c8267cd service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received unexpected event network-vif-unplugged-728a6d93-5334-466c-ae8c-42a7b45d7383 for instance with vm_state active and task_state None.
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-bc63afd6-826f-41fa-abd8-f96089a41b36 req-fad6b74d-961c-4808-a085-bf3681b4736f service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bc63afd6-826f-41fa-abd8-f96089a41b36 req-fad6b74d-961c-4808-a085-bf3681b4736f service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bc63afd6-826f-41fa-abd8-f96089a41b36 req-fad6b74d-961c-4808-a085-bf3681b4736f service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bc63afd6-826f-41fa-abd8-f96089a41b36 req-fad6b74d-961c-4808-a085-bf3681b4736f service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-bc63afd6-826f-41fa-abd8-f96089a41b36 req-fad6b74d-961c-4808-a085-bf3681b4736f service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:46 user nova-compute[74295]: WARNING nova.compute.manager [req-bc63afd6-826f-41fa-abd8-f96089a41b36 req-fad6b74d-961c-4808-a085-bf3681b4736f service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state building and task_state spawning.
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:29:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Instance spawned successfully.
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:46 user nova-compute[74295]: INFO nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Took 5.39 seconds to spawn the instance on the hypervisor.
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:29:46 user nova-compute[74295]: INFO nova.compute.manager [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Took 39.17 seconds to build instance.
Oct 26 06:29:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-76239623-97c2-4a1c-aaa1-a293bab227ae tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.295s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-1b7c05a0-87b8-470b-b5d1-0d1446e094e4 req-44ee4ef3-ee0c-45db-91b7-a59e23713f74 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-plugged-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1b7c05a0-87b8-470b-b5d1-0d1446e094e4 req-44ee4ef3-ee0c-45db-91b7-a59e23713f74 service nova] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1b7c05a0-87b8-470b-b5d1-0d1446e094e4 req-44ee4ef3-ee0c-45db-91b7-a59e23713f74 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1b7c05a0-87b8-470b-b5d1-0d1446e094e4 req-44ee4ef3-ee0c-45db-91b7-a59e23713f74 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-1b7c05a0-87b8-470b-b5d1-0d1446e094e4 req-44ee4ef3-ee0c-45db-91b7-a59e23713f74 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] No waiting events found dispatching network-vif-plugged-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:46 user nova-compute[74295]: WARNING nova.compute.manager [req-1b7c05a0-87b8-470b-b5d1-0d1446e094e4 req-44ee4ef3-ee0c-45db-91b7-a59e23713f74 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received unexpected event network-vif-plugged-728a6d93-5334-466c-ae8c-42a7b45d7383 for instance with vm_state active and task_state None.
Oct 26 06:29:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "48f22cde-4b90-43de-aba1-968afce2ddce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "48f22cde-4b90-43de-aba1-968afce2ddce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:29:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:29:48 user nova-compute[74295]: INFO nova.compute.claims [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Claim successful on node user
Oct 26 06:29:49 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG nova.network.neutron [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:29:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:29:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG nova.policy [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4691863b37da4920a7d50434b9f4584c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14561432954b4ce78599f0bd131a1863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:29:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Creating image(s)
Oct 26 06:29:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "/opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "/opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "/opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.263s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.250s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk 1073741824" returned: 0 in 0.066s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.248s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Successfully created port: 2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Cannot resize image /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Ensure instance console log exists: /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Successfully updated port: 2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "refresh_cache-48f22cde-4b90-43de-aba1-968afce2ddce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquired lock "refresh_cache-48f22cde-4b90-43de-aba1-968afce2ddce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-23d4010b-d215-41b3-a0d6-54c005aae90a req-1ccb4e45-2034-4aec-92b0-3a6c5f52c045 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received event network-changed-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-23d4010b-d215-41b3-a0d6-54c005aae90a req-1ccb4e45-2034-4aec-92b0-3a6c5f52c045 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Refreshing instance network info cache due to event network-changed-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-23d4010b-d215-41b3-a0d6-54c005aae90a req-1ccb4e45-2034-4aec-92b0-3a6c5f52c045 service nova] Acquiring lock "refresh_cache-48f22cde-4b90-43de-aba1-968afce2ddce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Updating instance_info_cache with network_info: [{"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Releasing lock "refresh_cache-48f22cde-4b90-43de-aba1-968afce2ddce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Instance network_info: |[{"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-23d4010b-d215-41b3-a0d6-54c005aae90a req-1ccb4e45-2034-4aec-92b0-3a6c5f52c045 service nova] Acquired lock "refresh_cache-48f22cde-4b90-43de-aba1-968afce2ddce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.network.neutron [req-23d4010b-d215-41b3-a0d6-54c005aae90a req-1ccb4e45-2034-4aec-92b0-3a6c5f52c045 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Refreshing network info cache for port 2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Start _get_guest_xml network_info=[{"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:29:51 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:29:51 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1273585285',display_name='tempest-VolumesAdminNegativeTest-server-1273585285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1273585285',id=13,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14561432954b4ce78599f0bd131a1863',ramdisk_id='',reservation_id='r-zulizrgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-417079322',owner_user_name='tempest-VolumesAdminNegativeTest-417079322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:29:49Z,user_data=None,user_id='4691863b37da4920a7d50434b9f4584c',uuid=48f22cde-4b90-43de-aba1-968afce2ddce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converting VIF {"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:ff,bridge_name='br-int',has_traffic_filtering=True,id=2c66b6d2-8f1f-4c4c-9a1c-da0b26028446,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c66b6d2-8f') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.objects.instance [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lazy-loading 'pci_devices' on Instance uuid 48f22cde-4b90-43de-aba1-968afce2ddce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:29:51 user nova-compute[74295]:   <uuid>48f22cde-4b90-43de-aba1-968afce2ddce</uuid>
Oct 26 06:29:51 user nova-compute[74295]:   <name>instance-0000000d</name>
Oct 26 06:29:51 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:29:51 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:29:51 user nova-compute[74295]:   <metadata>
Oct 26 06:29:51 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:29:51 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:29:51 user nova-compute[74295]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1273585285</nova:name>
Oct 26 06:29:51 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:29:51</nova:creationTime>
Oct 26 06:29:51 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:29:51 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:29:51 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:29:51 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:29:51 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:29:51 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:29:51 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:29:51 user nova-compute[74295]:       <nova:owner>
Oct 26 06:29:51 user nova-compute[74295]:         <nova:user uuid="4691863b37da4920a7d50434b9f4584c">tempest-VolumesAdminNegativeTest-417079322-project-member</nova:user>
Oct 26 06:29:51 user nova-compute[74295]:         <nova:project uuid="14561432954b4ce78599f0bd131a1863">tempest-VolumesAdminNegativeTest-417079322</nova:project>
Oct 26 06:29:51 user nova-compute[74295]:       </nova:owner>
Oct 26 06:29:51 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:29:51 user nova-compute[74295]:       <nova:ports>
Oct 26 06:29:51 user nova-compute[74295]:         <nova:port uuid="2c66b6d2-8f1f-4c4c-9a1c-da0b26028446">
Oct 26 06:29:51 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 06:29:51 user nova-compute[74295]:         </nova:port>
Oct 26 06:29:51 user nova-compute[74295]:       </nova:ports>
Oct 26 06:29:51 user nova-compute[74295]:     </nova:instance>
Oct 26 06:29:51 user nova-compute[74295]:   </metadata>
Oct 26 06:29:51 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:29:51 user nova-compute[74295]:     <system>
Oct 26 06:29:51 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:29:51 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:29:51 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:29:51 user nova-compute[74295]:       <entry name="serial">48f22cde-4b90-43de-aba1-968afce2ddce</entry>
Oct 26 06:29:51 user nova-compute[74295]:       <entry name="uuid">48f22cde-4b90-43de-aba1-968afce2ddce</entry>
Oct 26 06:29:51 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:29:51 user nova-compute[74295]:     </system>
Oct 26 06:29:51 user nova-compute[74295]:   </sysinfo>
Oct 26 06:29:51 user nova-compute[74295]:   <os>
Oct 26 06:29:51 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:29:51 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:29:51 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:29:51 user nova-compute[74295]:   </os>
Oct 26 06:29:51 user nova-compute[74295]:   <features>
Oct 26 06:29:51 user nova-compute[74295]:     <acpi/>
Oct 26 06:29:51 user nova-compute[74295]:     <apic/>
Oct 26 06:29:51 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:29:51 user nova-compute[74295]:   </features>
Oct 26 06:29:51 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:29:51 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:29:51 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:29:51 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:29:51 user nova-compute[74295]:   </clock>
Oct 26 06:29:51 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:29:51 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:29:51 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:29:51 user nova-compute[74295]:   </cpu>
Oct 26 06:29:51 user nova-compute[74295]:   <devices>
Oct 26 06:29:51 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:29:51 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:29:51 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk"/>
Oct 26 06:29:51 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:29:51 user nova-compute[74295]:     </disk>
Oct 26 06:29:51 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:29:51 user nova-compute[74295]:       <mac address="fa:16:3e:82:aa:ff"/>
Oct 26 06:29:51 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:29:51 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:29:51 user nova-compute[74295]:       <target dev="tap2c66b6d2-8f"/>
Oct 26 06:29:51 user nova-compute[74295]:     </interface>
Oct 26 06:29:51 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:29:51 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/console.log" append="off"/>
Oct 26 06:29:51 user nova-compute[74295]:     </serial>
Oct 26 06:29:51 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:29:51 user nova-compute[74295]:     <video>
Oct 26 06:29:51 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:29:51 user nova-compute[74295]:     </video>
Oct 26 06:29:51 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:29:51 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:29:51 user nova-compute[74295]:     </rng>
Oct 26 06:29:51 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:29:51 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:29:51 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:29:51 user nova-compute[74295]:     </memballoon>
Oct 26 06:29:51 user nova-compute[74295]:   </devices>
Oct 26 06:29:51 user nova-compute[74295]: </domain>
Oct 26 06:29:51 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1273585285',display_name='tempest-VolumesAdminNegativeTest-server-1273585285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1273585285',id=13,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14561432954b4ce78599f0bd131a1863',ramdisk_id='',reservation_id='r-zulizrgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-417079322',owner_user_name='tempest-VolumesAdminNegativeTest-417079322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:29:49Z,user_data=None,user_id='4691863b37da4920a7d50434b9f4584c',uuid=48f22cde-4b90-43de-aba1-968afce2ddce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converting VIF {"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:ff,bridge_name='br-int',has_traffic_filtering=True,id=2c66b6d2-8f1f-4c4c-9a1c-da0b26028446,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c66b6d2-8f') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG os_vif [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:ff,bridge_name='br-int',has_traffic_filtering=True,id=2c66b6d2-8f1f-4c4c-9a1c-da0b26028446,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c66b6d2-8f') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36a6122a-f3f2-5643-9145-5abdaaedf7f0', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c66b6d2-8f, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c66b6d2-8f, col_values=(('qos', UUID('d6ee7b69-4cf7-4ace-9157-84679f8e6a85')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c66b6d2-8f, col_values=(('external_ids', {'iface-id': '2c66b6d2-8f1f-4c4c-9a1c-da0b26028446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:aa:ff', 'vm-uuid': '48f22cde-4b90-43de-aba1-968afce2ddce'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:29:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:52 user nova-compute[74295]: INFO os_vif [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:ff,bridge_name='br-int',has_traffic_filtering=True,id=2c66b6d2-8f1f-4c4c-9a1c-da0b26028446,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c66b6d2-8f')
Oct 26 06:29:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:29:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] No VIF found with MAC fa:16:3e:82:aa:ff, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:29:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-23d4010b-d215-41b3-a0d6-54c005aae90a req-1ccb4e45-2034-4aec-92b0-3a6c5f52c045 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Updated VIF entry in instance network info cache for port 2c66b6d2-8f1f-4c4c-9a1c-da0b26028446. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:29:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-23d4010b-d215-41b3-a0d6-54c005aae90a req-1ccb4e45-2034-4aec-92b0-3a6c5f52c045 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Updating instance_info_cache with network_info: [{"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:29:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-23d4010b-d215-41b3-a0d6-54c005aae90a req-1ccb4e45-2034-4aec-92b0-3a6c5f52c045 service nova] Releasing lock "refresh_cache-48f22cde-4b90-43de-aba1-968afce2ddce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:29:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-079974a3-0a5f-4cec-8524-cd9ba5758f59 req-78ddfc2d-0729-4776-b904-9e1e583f4cdf service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received event network-vif-plugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-079974a3-0a5f-4cec-8524-cd9ba5758f59 req-78ddfc2d-0729-4776-b904-9e1e583f4cdf service nova] Acquiring lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-079974a3-0a5f-4cec-8524-cd9ba5758f59 req-78ddfc2d-0729-4776-b904-9e1e583f4cdf service nova] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-079974a3-0a5f-4cec-8524-cd9ba5758f59 req-78ddfc2d-0729-4776-b904-9e1e583f4cdf service nova] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-079974a3-0a5f-4cec-8524-cd9ba5758f59 req-78ddfc2d-0729-4776-b904-9e1e583f4cdf service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] No waiting events found dispatching network-vif-plugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:54 user nova-compute[74295]: WARNING nova.compute.manager [req-079974a3-0a5f-4cec-8524-cd9ba5758f59 req-78ddfc2d-0729-4776-b904-9e1e583f4cdf service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received unexpected event network-vif-plugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 for instance with vm_state building and task_state spawning.
Oct 26 06:29:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:29:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:29:55 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Instance spawned successfully.
Oct 26 06:29:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:29:56 user nova-compute[74295]: INFO nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Took 6.65 seconds to spawn the instance on the hypervisor.
Oct 26 06:29:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-30d33937-114d-4b1d-a296-ed3d6ae7e978 req-ebf8dd94-3c9b-4970-a62f-98a193d48849 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received event network-vif-plugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-30d33937-114d-4b1d-a296-ed3d6ae7e978 req-ebf8dd94-3c9b-4970-a62f-98a193d48849 service nova] Acquiring lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-30d33937-114d-4b1d-a296-ed3d6ae7e978 req-ebf8dd94-3c9b-4970-a62f-98a193d48849 service nova] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-30d33937-114d-4b1d-a296-ed3d6ae7e978 req-ebf8dd94-3c9b-4970-a62f-98a193d48849 service nova] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-30d33937-114d-4b1d-a296-ed3d6ae7e978 req-ebf8dd94-3c9b-4970-a62f-98a193d48849 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] No waiting events found dispatching network-vif-plugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:29:56 user nova-compute[74295]: WARNING nova.compute.manager [req-30d33937-114d-4b1d-a296-ed3d6ae7e978 req-ebf8dd94-3c9b-4970-a62f-98a193d48849 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received unexpected event network-vif-plugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 for instance with vm_state building and task_state spawning.
Oct 26 06:29:56 user nova-compute[74295]: INFO nova.compute.manager [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Took 7.68 seconds to build instance.
Oct 26 06:29:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-373ff92d-9c3f-4ed8-a32f-bde1751219c1 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "48f22cde-4b90-43de-aba1-968afce2ddce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.797s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG nova.objects.instance [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lazy-loading 'flavor' on Instance uuid 775d5e2e-95a6-4a86-b6f3-ce96735378d9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:59 user nova-compute[74295]: INFO nova.compute.manager [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Attaching volume 0f212bc3-b89c-4588-9186-df7b86c44e6b to /dev/vdb
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG os_brick.utils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d755f2-2210-4443-8224-853b21a1c10a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6202fc7-0278-49c0-b7ef-efe77afd9d13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f880fe-072c-457e-ad0f-4eec86dba892]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f1f7e4-f6d6-4c1f-9e74-a2f36ddafd46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:29:59 user nova-compute[74295]: INFO nova.compute.claims [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Claim successful on node user
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:29:59 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:29:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3062514-f73a-42c6-85fb-60bc9f766122]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG os_brick.utils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:29:59 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating existing volume attachment record: ec670b34-5a06-4b5d-800a-ccc8a51bfd9a {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.844s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:30:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:30:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG nova.policy [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3c3d6fa25d143bc935e7e16275aac57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b6035868e347c4b90651f3ad73237a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:30:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Creating image(s)
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.206s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.267s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk 1073741824" returned: 0 in 0.062s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.208s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Successfully created port: 2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Cannot resize image /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Ensure instance console log exists: /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Successfully updated port: 2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "refresh_cache-cf010631-119f-42b0-a356-a645b27e4081" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquired lock "refresh_cache-cf010631-119f-42b0-a356-a645b27e4081" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-e2c182ab-4e52-4678-bd36-2def2ab36b00 req-61136258-e014-4c41-b128-ba0656f7cbf0 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-changed-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-e2c182ab-4e52-4678-bd36-2def2ab36b00 req-61136258-e014-4c41-b128-ba0656f7cbf0 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Refreshing instance network info cache due to event network-changed-2b5d323f-8884-4acb-a176-40dfcf957402. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e2c182ab-4e52-4678-bd36-2def2ab36b00 req-61136258-e014-4c41-b128-ba0656f7cbf0 service nova] Acquiring lock "refresh_cache-cf010631-119f-42b0-a356-a645b27e4081" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Updating instance_info_cache with network_info: [{"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Releasing lock "refresh_cache-cf010631-119f-42b0-a356-a645b27e4081" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Instance network_info: |[{"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e2c182ab-4e52-4678-bd36-2def2ab36b00 req-61136258-e014-4c41-b128-ba0656f7cbf0 service nova] Acquired lock "refresh_cache-cf010631-119f-42b0-a356-a645b27e4081" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-e2c182ab-4e52-4678-bd36-2def2ab36b00 req-61136258-e014-4c41-b128-ba0656f7cbf0 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Refreshing network info cache for port 2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Start _get_guest_xml network_info=[{"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:30:03 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:30:03 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-213606875',display_name='tempest-tempest.common.compute-instance-213606875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-213606875',id=14,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtH+FO/rcPVmXXNwudgrvBLEMmMcqmnAHUrdcVJlWtaZpsycsfMyvP1tJmmBYEi4UMNSFlb3baPyXSYG4kOajpOED31FcaPy44SBBtSx6sYgvc6+6JiuCiXwwpnNliueA==',key_name='tempest-keypair-1139203649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-k4edxa0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=cf010631-119f-42b0-a356-a645b27e4081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'pci_devices' on Instance uuid cf010631-119f-42b0-a356-a645b27e4081 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance_info_cache with network_info: [{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:30:03 user nova-compute[74295]:   <uuid>cf010631-119f-42b0-a356-a645b27e4081</uuid>
Oct 26 06:30:03 user nova-compute[74295]:   <name>instance-0000000e</name>
Oct 26 06:30:03 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:30:03 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:30:03 user nova-compute[74295]:   <metadata>
Oct 26 06:30:03 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:30:03 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:30:03 user nova-compute[74295]:       <nova:name>tempest-tempest.common.compute-instance-213606875</nova:name>
Oct 26 06:30:03 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:30:03</nova:creationTime>
Oct 26 06:30:03 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:30:03 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:30:03 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:30:03 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:30:03 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:30:03 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:30:03 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:30:03 user nova-compute[74295]:       <nova:owner>
Oct 26 06:30:03 user nova-compute[74295]:         <nova:user uuid="e3c3d6fa25d143bc935e7e16275aac57">tempest-ServerActionsTestOtherA-911482981-project-member</nova:user>
Oct 26 06:30:03 user nova-compute[74295]:         <nova:project uuid="83b6035868e347c4b90651f3ad73237a">tempest-ServerActionsTestOtherA-911482981</nova:project>
Oct 26 06:30:03 user nova-compute[74295]:       </nova:owner>
Oct 26 06:30:03 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:30:03 user nova-compute[74295]:       <nova:ports>
Oct 26 06:30:03 user nova-compute[74295]:         <nova:port uuid="2b5d323f-8884-4acb-a176-40dfcf957402">
Oct 26 06:30:03 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:30:03 user nova-compute[74295]:         </nova:port>
Oct 26 06:30:03 user nova-compute[74295]:       </nova:ports>
Oct 26 06:30:03 user nova-compute[74295]:     </nova:instance>
Oct 26 06:30:03 user nova-compute[74295]:   </metadata>
Oct 26 06:30:03 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:30:03 user nova-compute[74295]:     <system>
Oct 26 06:30:03 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:30:03 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:30:03 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:30:03 user nova-compute[74295]:       <entry name="serial">cf010631-119f-42b0-a356-a645b27e4081</entry>
Oct 26 06:30:03 user nova-compute[74295]:       <entry name="uuid">cf010631-119f-42b0-a356-a645b27e4081</entry>
Oct 26 06:30:03 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:30:03 user nova-compute[74295]:     </system>
Oct 26 06:30:03 user nova-compute[74295]:   </sysinfo>
Oct 26 06:30:03 user nova-compute[74295]:   <os>
Oct 26 06:30:03 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:30:03 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:30:03 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:30:03 user nova-compute[74295]:   </os>
Oct 26 06:30:03 user nova-compute[74295]:   <features>
Oct 26 06:30:03 user nova-compute[74295]:     <acpi/>
Oct 26 06:30:03 user nova-compute[74295]:     <apic/>
Oct 26 06:30:03 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:30:03 user nova-compute[74295]:   </features>
Oct 26 06:30:03 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:30:03 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:30:03 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:30:03 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:30:03 user nova-compute[74295]:   </clock>
Oct 26 06:30:03 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:30:03 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:30:03 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:30:03 user nova-compute[74295]:   </cpu>
Oct 26 06:30:03 user nova-compute[74295]:   <devices>
Oct 26 06:30:03 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:30:03 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:30:03 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk"/>
Oct 26 06:30:03 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:30:03 user nova-compute[74295]:     </disk>
Oct 26 06:30:03 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:30:03 user nova-compute[74295]:       <mac address="fa:16:3e:59:49:33"/>
Oct 26 06:30:03 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:30:03 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:30:03 user nova-compute[74295]:       <target dev="tap2b5d323f-88"/>
Oct 26 06:30:03 user nova-compute[74295]:     </interface>
Oct 26 06:30:03 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:30:03 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/console.log" append="off"/>
Oct 26 06:30:03 user nova-compute[74295]:     </serial>
Oct 26 06:30:03 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:30:03 user nova-compute[74295]:     <video>
Oct 26 06:30:03 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:30:03 user nova-compute[74295]:     </video>
Oct 26 06:30:03 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:30:03 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:30:03 user nova-compute[74295]:     </rng>
Oct 26 06:30:03 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:30:03 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:30:03 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:30:03 user nova-compute[74295]:     </memballoon>
Oct 26 06:30:03 user nova-compute[74295]:   </devices>
Oct 26 06:30:03 user nova-compute[74295]: </domain>
Oct 26 06:30:03 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-213606875',display_name='tempest-tempest.common.compute-instance-213606875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-213606875',id=14,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtH+FO/rcPVmXXNwudgrvBLEMmMcqmnAHUrdcVJlWtaZpsycsfMyvP1tJmmBYEi4UMNSFlb3baPyXSYG4kOajpOED31FcaPy44SBBtSx6sYgvc6+6JiuCiXwwpnNliueA==',key_name='tempest-keypair-1139203649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-k4edxa0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=cf010631-119f-42b0-a356-a645b27e4081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG os_vif [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14314c68-91a8-5f25-a22a-def5af88d926', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b5d323f-88, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b5d323f-88, col_values=(('qos', UUID('6f028927-479f-4cdc-9b0b-9a352b8455bf')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b5d323f-88, col_values=(('external_ids', {'iface-id': '2b5d323f-8884-4acb-a176-40dfcf957402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:49:33', 'vm-uuid': 'cf010631-119f-42b0-a356-a645b27e4081'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:03 user nova-compute[74295]: INFO os_vif [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88')
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No VIF found with MAC fa:16:3e:59:49:33, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-e2c182ab-4e52-4678-bd36-2def2ab36b00 req-61136258-e014-4c41-b128-ba0656f7cbf0 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Updated VIF entry in instance network info cache for port 2b5d323f-8884-4acb-a176-40dfcf957402. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-e2c182ab-4e52-4678-bd36-2def2ab36b00 req-61136258-e014-4c41-b128-ba0656f7cbf0 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Updating instance_info_cache with network_info: [{"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e2c182ab-4e52-4678-bd36-2def2ab36b00 req-61136258-e014-4c41-b128-ba0656f7cbf0 service nova] Releasing lock "refresh_cache-cf010631-119f-42b0-a356-a645b27e4081" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:04 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Waiting for libvirt event about the detach of device tap728a6d93-53 with device alias net1 from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 is timed out.
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface> {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 26 06:30:04 user nova-compute[74295]:   <name>instance-00000009</name>
Oct 26 06:30:04 user nova-compute[74295]:   <uuid>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</uuid>
Oct 26 06:30:04 user nova-compute[74295]:   <metadata>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:30:04 user nova-compute[74295]:   <nova:package version="0.0.0"/>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:name>tempest-device-tagging-server-235576379</nova:name>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:creationTime>2023-10-26 06:28:34</nova:creationTime>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:flavor name="m1.tiny">
Oct 26 06:30:04 user nova-compute[74295]:     <nova:memory>512</nova:memory>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:disk>1</nova:disk>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:swap>0</nova:swap>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:vcpus>1</nova:vcpus>
Oct 26 06:30:04 user nova-compute[74295]:   </nova:flavor>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:owner>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:user uuid="620a58893e6f41a1ae1e57f672427d61">tempest-TaggedAttachmentsTest-1270357865-project-member</nova:user>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:project uuid="5684b5893b604af484029883dbf5132b">tempest-TaggedAttachmentsTest-1270357865</nova:project>
Oct 26 06:30:04 user nova-compute[74295]:   </nova:owner>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:ports>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:port uuid="ba4ab381-015f-4485-8618-e7c48a5f0d26">
Oct 26 06:30:04 user nova-compute[74295]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:30:04 user nova-compute[74295]:     </nova:port>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:port uuid="728a6d93-5334-466c-ae8c-42a7b45d7383">
Oct 26 06:30:04 user nova-compute[74295]:       <nova:ip type="fixed" address="10.10.10.101" ipVersion="4"/>
Oct 26 06:30:04 user nova-compute[74295]:     </nova:port>
Oct 26 06:30:04 user nova-compute[74295]:   </nova:ports>
Oct 26 06:30:04 user nova-compute[74295]: </nova:instance>
Oct 26 06:30:04 user nova-compute[74295]:   </metadata>
Oct 26 06:30:04 user nova-compute[74295]:   <memory unit='KiB'>524288</memory>
Oct 26 06:30:04 user nova-compute[74295]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 06:30:04 user nova-compute[74295]:   <vcpu placement='static'>1</vcpu>
Oct 26 06:30:04 user nova-compute[74295]:   <resource>
Oct 26 06:30:04 user nova-compute[74295]:     <partition>/machine</partition>
Oct 26 06:30:04 user nova-compute[74295]:   </resource>
Oct 26 06:30:04 user nova-compute[74295]:   <sysinfo type='smbios'>
Oct 26 06:30:04 user nova-compute[74295]:     <system>
Oct 26 06:30:04 user nova-compute[74295]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 06:30:04 user nova-compute[74295]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 06:30:04 user nova-compute[74295]:       <entry name='version'>0.0.0</entry>
Oct 26 06:30:04 user nova-compute[74295]:       <entry name='serial'>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:30:04 user nova-compute[74295]:       <entry name='uuid'>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:30:04 user nova-compute[74295]:       <entry name='family'>Virtual Machine</entry>
Oct 26 06:30:04 user nova-compute[74295]:     </system>
Oct 26 06:30:04 user nova-compute[74295]:   </sysinfo>
Oct 26 06:30:04 user nova-compute[74295]:   <os>
Oct 26 06:30:04 user nova-compute[74295]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 06:30:04 user nova-compute[74295]:     <boot dev='hd'/>
Oct 26 06:30:04 user nova-compute[74295]:     <smbios mode='sysinfo'/>
Oct 26 06:30:04 user nova-compute[74295]:   </os>
Oct 26 06:30:04 user nova-compute[74295]:   <features>
Oct 26 06:30:04 user nova-compute[74295]:     <acpi/>
Oct 26 06:30:04 user nova-compute[74295]:     <apic/>
Oct 26 06:30:04 user nova-compute[74295]:     <vmcoreinfo state='on'/>
Oct 26 06:30:04 user nova-compute[74295]:   </features>
Oct 26 06:30:04 user nova-compute[74295]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 06:30:04 user nova-compute[74295]:     <model fallback='forbid'>Nehalem</model>
Oct 26 06:30:04 user nova-compute[74295]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 06:30:04 user nova-compute[74295]:     <feature policy='require' name='vme'/>
Oct 26 06:30:04 user nova-compute[74295]:     <feature policy='require' name='x2apic'/>
Oct 26 06:30:04 user nova-compute[74295]:     <feature policy='require' name='hypervisor'/>
Oct 26 06:30:04 user nova-compute[74295]:   </cpu>
Oct 26 06:30:04 user nova-compute[74295]:   <clock offset='utc'>
Oct 26 06:30:04 user nova-compute[74295]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 06:30:04 user nova-compute[74295]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 06:30:04 user nova-compute[74295]:     <timer name='hpet' present='no'/>
Oct 26 06:30:04 user nova-compute[74295]:   </clock>
Oct 26 06:30:04 user nova-compute[74295]:   <on_poweroff>destroy</on_poweroff>
Oct 26 06:30:04 user nova-compute[74295]:   <on_reboot>restart</on_reboot>
Oct 26 06:30:04 user nova-compute[74295]:   <on_crash>destroy</on_crash>
Oct 26 06:30:04 user nova-compute[74295]:   <devices>
Oct 26 06:30:04 user nova-compute[74295]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 06:30:04 user nova-compute[74295]:     <disk type='file' device='disk'>
Oct 26 06:30:04 user nova-compute[74295]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 06:30:04 user nova-compute[74295]:       <source file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk' index='2'/>
Oct 26 06:30:04 user nova-compute[74295]:       <backingStore type='file' index='3'>
Oct 26 06:30:04 user nova-compute[74295]:         <format type='raw'/>
Oct 26 06:30:04 user nova-compute[74295]:         <source file='/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799'/>
Oct 26 06:30:04 user nova-compute[74295]:         <backingStore/>
Oct 26 06:30:04 user nova-compute[74295]:       </backingStore>
Oct 26 06:30:04 user nova-compute[74295]:       <target dev='vda' bus='virtio'/>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='virtio-disk0'/>
Oct 26 06:30:04 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </disk>
Oct 26 06:30:04 user nova-compute[74295]:     <disk type='file' device='cdrom'>
Oct 26 06:30:04 user nova-compute[74295]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 06:30:04 user nova-compute[74295]:       <source file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.config' index='1'/>
Oct 26 06:30:04 user nova-compute[74295]:       <backingStore/>
Oct 26 06:30:04 user nova-compute[74295]:       <target dev='hda' bus='ide'/>
Oct 26 06:30:04 user nova-compute[74295]:       <readonly/>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='ide0-0-0'/>
Oct 26 06:30:04 user nova-compute[74295]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </disk>
Oct 26 06:30:04 user nova-compute[74295]:     <controller type='usb' index='0' model='none'>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='usb'/>
Oct 26 06:30:04 user nova-compute[74295]:     </controller>
Oct 26 06:30:04 user nova-compute[74295]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='pci.0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </controller>
Oct 26 06:30:04 user nova-compute[74295]:     <controller type='ide' index='0'>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='ide'/>
Oct 26 06:30:04 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 06:30:04 user nova-compute[74295]:     </controller>
Oct 26 06:30:04 user nova-compute[74295]:     <interface type='ethernet'>
Oct 26 06:30:04 user nova-compute[74295]:       <mac address='fa:16:3e:60:fd:c1'/>
Oct 26 06:30:04 user nova-compute[74295]:       <target dev='tapba4ab381-01'/>
Oct 26 06:30:04 user nova-compute[74295]:       <model type='virtio'/>
Oct 26 06:30:04 user nova-compute[74295]:       <mtu size='1442'/>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='net0'/>
Oct 26 06:30:04 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </interface>
Oct 26 06:30:04 user nova-compute[74295]:     <serial type='pty'>
Oct 26 06:30:04 user nova-compute[74295]:       <source path='/dev/pts/8'/>
Oct 26 06:30:04 user nova-compute[74295]:       <log file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log' append='off'/>
Oct 26 06:30:04 user nova-compute[74295]:       <target type='isa-serial' port='0'>
Oct 26 06:30:04 user nova-compute[74295]:         <model name='isa-serial'/>
Oct 26 06:30:04 user nova-compute[74295]:       </target>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='serial0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </serial>
Oct 26 06:30:04 user nova-compute[74295]:     <console type='pty' tty='/dev/pts/8'>
Oct 26 06:30:04 user nova-compute[74295]:       <source path='/dev/pts/8'/>
Oct 26 06:30:04 user nova-compute[74295]:       <log file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log' append='off'/>
Oct 26 06:30:04 user nova-compute[74295]:       <target type='serial' port='0'/>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='serial0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </console>
Oct 26 06:30:04 user nova-compute[74295]:     <input type='mouse' bus='ps2'>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='input0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </input>
Oct 26 06:30:04 user nova-compute[74295]:     <input type='keyboard' bus='ps2'>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='input1'/>
Oct 26 06:30:04 user nova-compute[74295]:     </input>
Oct 26 06:30:04 user nova-compute[74295]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 26 06:30:04 user nova-compute[74295]:       <listen type='address' address='0.0.0.0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </graphics>
Oct 26 06:30:04 user nova-compute[74295]:     <audio id='1' type='none'/>
Oct 26 06:30:04 user nova-compute[74295]:     <video>
Oct 26 06:30:04 user nova-compute[74295]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='video0'/>
Oct 26 06:30:04 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </video>
Oct 26 06:30:04 user nova-compute[74295]:     <memballoon model='virtio'>
Oct 26 06:30:04 user nova-compute[74295]:       <stats period='10'/>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='balloon0'/>
Oct 26 06:30:04 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </memballoon>
Oct 26 06:30:04 user nova-compute[74295]:     <rng model='virtio'>
Oct 26 06:30:04 user nova-compute[74295]:       <backend model='random'>/dev/urandom</backend>
Oct 26 06:30:04 user nova-compute[74295]:       <alias name='rng0'/>
Oct 26 06:30:04 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 06:30:04 user nova-compute[74295]:     </rng>
Oct 26 06:30:04 user nova-compute[74295]:   </devices>
Oct 26 06:30:04 user nova-compute[74295]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 06:30:04 user nova-compute[74295]:     <label>libvirt-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</label>
Oct 26 06:30:04 user nova-compute[74295]:     <imagelabel>libvirt-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</imagelabel>
Oct 26 06:30:04 user nova-compute[74295]:   </seclabel>
Oct 26 06:30:04 user nova-compute[74295]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 06:30:04 user nova-compute[74295]:     <label>+64055:+108</label>
Oct 26 06:30:04 user nova-compute[74295]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 06:30:04 user nova-compute[74295]:   </seclabel>
Oct 26 06:30:04 user nova-compute[74295]: </domain>
Oct 26 06:30:04 user nova-compute[74295]:  {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 06:30:04 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Successfully detached device tap728a6d93-53 from instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 from the live domain config.
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235576379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235576379',id=9,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWyzCZKNfN++RdhZ7vCbqyQNIYdI761TFaG7JRpiZgjn40o6GYxEOHQNTFN5QLWKwFHwjbW8YmEMF7M/0RDutFK5QOejaU2AoitJ/iwiYQOMZr1KHRuqURWMhnnUXc/g==',key_name='tempest-keypair-916215385',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5684b5893b604af484029883dbf5132b',ramdisk_id='',reservation_id='r-oovp6ig1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1270357865',owner_user_name='tempest-TaggedAttachmentsTest-1270357865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='620a58893e6f41a1ae1e57f672427d61',uuid=4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converting VIF {"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG os_vif [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap728a6d93-53, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c691f241-c964-4437-abbe-47291c60ada9) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:04 user nova-compute[74295]: INFO os_vif [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53')
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:30:04 user nova-compute[74295]:   <nova:package version="0.0.0"/>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:name>tempest-device-tagging-server-235576379</nova:name>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:creationTime>2023-10-26 06:30:04</nova:creationTime>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:flavor name="m1.tiny">
Oct 26 06:30:04 user nova-compute[74295]:     <nova:memory>512</nova:memory>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:disk>1</nova:disk>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:swap>0</nova:swap>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:vcpus>1</nova:vcpus>
Oct 26 06:30:04 user nova-compute[74295]:   </nova:flavor>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:owner>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:user uuid="620a58893e6f41a1ae1e57f672427d61">tempest-TaggedAttachmentsTest-1270357865-project-member</nova:user>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:project uuid="5684b5893b604af484029883dbf5132b">tempest-TaggedAttachmentsTest-1270357865</nova:project>
Oct 26 06:30:04 user nova-compute[74295]:   </nova:owner>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:30:04 user nova-compute[74295]:   <nova:ports>
Oct 26 06:30:04 user nova-compute[74295]:     <nova:port uuid="ba4ab381-015f-4485-8618-e7c48a5f0d26">
Oct 26 06:30:04 user nova-compute[74295]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:30:04 user nova-compute[74295]:     </nova:port>
Oct 26 06:30:04 user nova-compute[74295]:   </nova:ports>
Oct 26 06:30:04 user nova-compute[74295]: </nova:instance>
Oct 26 06:30:04 user nova-compute[74295]:  {{(pid=74295) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:30:04 user nova-compute[74295]: INFO nova.compute.claims [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Claim successful on node user
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-deleted-728a6d93-5334-466c-ae8c-42a7b45d7383 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:05 user nova-compute[74295]: INFO nova.compute.manager [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Neutron deleted interface 728a6d93-5334-466c-ae8c-42a7b45d7383; detaching it from the instance and deleting it from the info cache
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updating instance_info_cache with network_info: [{"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquired lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.objects.instance [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] Lazy-loading 'system_metadata' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.objects.instance [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] Lazy-loading 'flavor' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.objects.base [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] Object Instance<4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08> lazy-loaded attributes: system_metadata,flavor {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235576379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235576379',id=9,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWyzCZKNfN++RdhZ7vCbqyQNIYdI761TFaG7JRpiZgjn40o6GYxEOHQNTFN5QLWKwFHwjbW8YmEMF7M/0RDutFK5QOejaU2AoitJ/iwiYQOMZr1KHRuqURWMhnnUXc/g==',key_name='tempest-keypair-916215385',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5684b5893b604af484029883dbf5132b',ramdisk_id='',reservation_id='r-oovp6ig1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1270357865',owner_user_name='tempest-TaggedAttachmentsTest-1270357865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='620a58893e6f41a1ae1e57f672427d61',uuid=4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.network.os_vif_util [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] Converting VIF {"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.network.os_vif_util [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface> {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 26 06:30:05 user nova-compute[74295]:   <name>instance-00000009</name>
Oct 26 06:30:05 user nova-compute[74295]:   <uuid>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</uuid>
Oct 26 06:30:05 user nova-compute[74295]:   <metadata>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:30:05 user nova-compute[74295]:   <nova:package version="0.0.0"/>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:name>tempest-device-tagging-server-235576379</nova:name>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:creationTime>2023-10-26 06:30:04</nova:creationTime>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:flavor name="m1.tiny">
Oct 26 06:30:05 user nova-compute[74295]:     <nova:memory>512</nova:memory>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:disk>1</nova:disk>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:swap>0</nova:swap>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:vcpus>1</nova:vcpus>
Oct 26 06:30:05 user nova-compute[74295]:   </nova:flavor>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:owner>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:user uuid="620a58893e6f41a1ae1e57f672427d61">tempest-TaggedAttachmentsTest-1270357865-project-member</nova:user>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:project uuid="5684b5893b604af484029883dbf5132b">tempest-TaggedAttachmentsTest-1270357865</nova:project>
Oct 26 06:30:05 user nova-compute[74295]:   </nova:owner>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:ports>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:port uuid="ba4ab381-015f-4485-8618-e7c48a5f0d26">
Oct 26 06:30:05 user nova-compute[74295]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:30:05 user nova-compute[74295]:     </nova:port>
Oct 26 06:30:05 user nova-compute[74295]:   </nova:ports>
Oct 26 06:30:05 user nova-compute[74295]: </nova:instance>
Oct 26 06:30:05 user nova-compute[74295]:   </metadata>
Oct 26 06:30:05 user nova-compute[74295]:   <memory unit='KiB'>524288</memory>
Oct 26 06:30:05 user nova-compute[74295]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 06:30:05 user nova-compute[74295]:   <vcpu placement='static'>1</vcpu>
Oct 26 06:30:05 user nova-compute[74295]:   <resource>
Oct 26 06:30:05 user nova-compute[74295]:     <partition>/machine</partition>
Oct 26 06:30:05 user nova-compute[74295]:   </resource>
Oct 26 06:30:05 user nova-compute[74295]:   <sysinfo type='smbios'>
Oct 26 06:30:05 user nova-compute[74295]:     <system>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='version'>0.0.0</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='serial'>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='uuid'>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='family'>Virtual Machine</entry>
Oct 26 06:30:05 user nova-compute[74295]:     </system>
Oct 26 06:30:05 user nova-compute[74295]:   </sysinfo>
Oct 26 06:30:05 user nova-compute[74295]:   <os>
Oct 26 06:30:05 user nova-compute[74295]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 06:30:05 user nova-compute[74295]:     <boot dev='hd'/>
Oct 26 06:30:05 user nova-compute[74295]:     <smbios mode='sysinfo'/>
Oct 26 06:30:05 user nova-compute[74295]:   </os>
Oct 26 06:30:05 user nova-compute[74295]:   <features>
Oct 26 06:30:05 user nova-compute[74295]:     <acpi/>
Oct 26 06:30:05 user nova-compute[74295]:     <apic/>
Oct 26 06:30:05 user nova-compute[74295]:     <vmcoreinfo state='on'/>
Oct 26 06:30:05 user nova-compute[74295]:   </features>
Oct 26 06:30:05 user nova-compute[74295]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 06:30:05 user nova-compute[74295]:     <model fallback='forbid'>Nehalem</model>
Oct 26 06:30:05 user nova-compute[74295]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 06:30:05 user nova-compute[74295]:     <feature policy='require' name='vme'/>
Oct 26 06:30:05 user nova-compute[74295]:     <feature policy='require' name='x2apic'/>
Oct 26 06:30:05 user nova-compute[74295]:     <feature policy='require' name='hypervisor'/>
Oct 26 06:30:05 user nova-compute[74295]:   </cpu>
Oct 26 06:30:05 user nova-compute[74295]:   <clock offset='utc'>
Oct 26 06:30:05 user nova-compute[74295]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 06:30:05 user nova-compute[74295]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 06:30:05 user nova-compute[74295]:     <timer name='hpet' present='no'/>
Oct 26 06:30:05 user nova-compute[74295]:   </clock>
Oct 26 06:30:05 user nova-compute[74295]:   <on_poweroff>destroy</on_poweroff>
Oct 26 06:30:05 user nova-compute[74295]:   <on_reboot>restart</on_reboot>
Oct 26 06:30:05 user nova-compute[74295]:   <on_crash>destroy</on_crash>
Oct 26 06:30:05 user nova-compute[74295]:   <devices>
Oct 26 06:30:05 user nova-compute[74295]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 06:30:05 user nova-compute[74295]:     <disk type='file' device='disk'>
Oct 26 06:30:05 user nova-compute[74295]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 06:30:05 user nova-compute[74295]:       <source file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk' index='2'/>
Oct 26 06:30:05 user nova-compute[74295]:       <backingStore type='file' index='3'>
Oct 26 06:30:05 user nova-compute[74295]:         <format type='raw'/>
Oct 26 06:30:05 user nova-compute[74295]:         <source file='/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799'/>
Oct 26 06:30:05 user nova-compute[74295]:         <backingStore/>
Oct 26 06:30:05 user nova-compute[74295]:       </backingStore>
Oct 26 06:30:05 user nova-compute[74295]:       <target dev='vda' bus='virtio'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='virtio-disk0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </disk>
Oct 26 06:30:05 user nova-compute[74295]:     <disk type='file' device='cdrom'>
Oct 26 06:30:05 user nova-compute[74295]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 06:30:05 user nova-compute[74295]:       <source file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.config' index='1'/>
Oct 26 06:30:05 user nova-compute[74295]:       <backingStore/>
Oct 26 06:30:05 user nova-compute[74295]:       <target dev='hda' bus='ide'/>
Oct 26 06:30:05 user nova-compute[74295]:       <readonly/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='ide0-0-0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </disk>
Oct 26 06:30:05 user nova-compute[74295]:     <controller type='usb' index='0' model='none'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='usb'/>
Oct 26 06:30:05 user nova-compute[74295]:     </controller>
Oct 26 06:30:05 user nova-compute[74295]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='pci.0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </controller>
Oct 26 06:30:05 user nova-compute[74295]:     <controller type='ide' index='0'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='ide'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 06:30:05 user nova-compute[74295]:     </controller>
Oct 26 06:30:05 user nova-compute[74295]:     <interface type='ethernet'>
Oct 26 06:30:05 user nova-compute[74295]:       <mac address='fa:16:3e:60:fd:c1'/>
Oct 26 06:30:05 user nova-compute[74295]:       <target dev='tapba4ab381-01'/>
Oct 26 06:30:05 user nova-compute[74295]:       <model type='virtio'/>
Oct 26 06:30:05 user nova-compute[74295]:       <mtu size='1442'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='net0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </interface>
Oct 26 06:30:05 user nova-compute[74295]:     <serial type='pty'>
Oct 26 06:30:05 user nova-compute[74295]:       <source path='/dev/pts/8'/>
Oct 26 06:30:05 user nova-compute[74295]:       <log file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log' append='off'/>
Oct 26 06:30:05 user nova-compute[74295]:       <target type='isa-serial' port='0'>
Oct 26 06:30:05 user nova-compute[74295]:         <model name='isa-serial'/>
Oct 26 06:30:05 user nova-compute[74295]:       </target>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='serial0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </serial>
Oct 26 06:30:05 user nova-compute[74295]:     <console type='pty' tty='/dev/pts/8'>
Oct 26 06:30:05 user nova-compute[74295]:       <source path='/dev/pts/8'/>
Oct 26 06:30:05 user nova-compute[74295]:       <log file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log' append='off'/>
Oct 26 06:30:05 user nova-compute[74295]:       <target type='serial' port='0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='serial0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </console>
Oct 26 06:30:05 user nova-compute[74295]:     <input type='mouse' bus='ps2'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='input0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </input>
Oct 26 06:30:05 user nova-compute[74295]:     <input type='keyboard' bus='ps2'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='input1'/>
Oct 26 06:30:05 user nova-compute[74295]:     </input>
Oct 26 06:30:05 user nova-compute[74295]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 26 06:30:05 user nova-compute[74295]:       <listen type='address' address='0.0.0.0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </graphics>
Oct 26 06:30:05 user nova-compute[74295]:     <audio id='1' type='none'/>
Oct 26 06:30:05 user nova-compute[74295]:     <video>
Oct 26 06:30:05 user nova-compute[74295]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='video0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </video>
Oct 26 06:30:05 user nova-compute[74295]:     <memballoon model='virtio'>
Oct 26 06:30:05 user nova-compute[74295]:       <stats period='10'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='balloon0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </memballoon>
Oct 26 06:30:05 user nova-compute[74295]:     <rng model='virtio'>
Oct 26 06:30:05 user nova-compute[74295]:       <backend model='random'>/dev/urandom</backend>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='rng0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </rng>
Oct 26 06:30:05 user nova-compute[74295]:   </devices>
Oct 26 06:30:05 user nova-compute[74295]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 06:30:05 user nova-compute[74295]:     <label>libvirt-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</label>
Oct 26 06:30:05 user nova-compute[74295]:     <imagelabel>libvirt-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</imagelabel>
Oct 26 06:30:05 user nova-compute[74295]:   </seclabel>
Oct 26 06:30:05 user nova-compute[74295]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 06:30:05 user nova-compute[74295]:     <label>+64055:+108</label>
Oct 26 06:30:05 user nova-compute[74295]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 06:30:05 user nova-compute[74295]:   </seclabel>
Oct 26 06:30:05 user nova-compute[74295]: </domain>
Oct 26 06:30:05 user nova-compute[74295]:  {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface> {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-8d5f3dd6-5f9b-4f6c-bcbd-6bb01fc11f47 req-1f9c22d1-29a9-4dd2-91bf-8a9dbd967713 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8d5f3dd6-5f9b-4f6c-bcbd-6bb01fc11f47 req-1f9c22d1-29a9-4dd2-91bf-8a9dbd967713 service nova] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8d5f3dd6-5f9b-4f6c-bcbd-6bb01fc11f47 req-1f9c22d1-29a9-4dd2-91bf-8a9dbd967713 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8d5f3dd6-5f9b-4f6c-bcbd-6bb01fc11f47 req-1f9c22d1-29a9-4dd2-91bf-8a9dbd967713 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-8d5f3dd6-5f9b-4f6c-bcbd-6bb01fc11f47 req-1f9c22d1-29a9-4dd2-91bf-8a9dbd967713 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] No waiting events found dispatching network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:05 user nova-compute[74295]: WARNING nova.compute.manager [req-8d5f3dd6-5f9b-4f6c-bcbd-6bb01fc11f47 req-1f9c22d1-29a9-4dd2-91bf-8a9dbd967713 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received unexpected event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 for instance with vm_state building and task_state spawning.
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:7f:54"/><model type="virtio"/><mtu size="1442"/><target dev="tap728a6d93-53"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 26 06:30:05 user nova-compute[74295]:   <name>instance-00000009</name>
Oct 26 06:30:05 user nova-compute[74295]:   <uuid>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</uuid>
Oct 26 06:30:05 user nova-compute[74295]:   <metadata>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:30:05 user nova-compute[74295]:   <nova:package version="0.0.0"/>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:name>tempest-device-tagging-server-235576379</nova:name>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:creationTime>2023-10-26 06:30:04</nova:creationTime>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:flavor name="m1.tiny">
Oct 26 06:30:05 user nova-compute[74295]:     <nova:memory>512</nova:memory>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:disk>1</nova:disk>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:swap>0</nova:swap>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:vcpus>1</nova:vcpus>
Oct 26 06:30:05 user nova-compute[74295]:   </nova:flavor>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:owner>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:user uuid="620a58893e6f41a1ae1e57f672427d61">tempest-TaggedAttachmentsTest-1270357865-project-member</nova:user>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:project uuid="5684b5893b604af484029883dbf5132b">tempest-TaggedAttachmentsTest-1270357865</nova:project>
Oct 26 06:30:05 user nova-compute[74295]:   </nova:owner>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:ports>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:port uuid="ba4ab381-015f-4485-8618-e7c48a5f0d26">
Oct 26 06:30:05 user nova-compute[74295]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:30:05 user nova-compute[74295]:     </nova:port>
Oct 26 06:30:05 user nova-compute[74295]:   </nova:ports>
Oct 26 06:30:05 user nova-compute[74295]: </nova:instance>
Oct 26 06:30:05 user nova-compute[74295]:   </metadata>
Oct 26 06:30:05 user nova-compute[74295]:   <memory unit='KiB'>524288</memory>
Oct 26 06:30:05 user nova-compute[74295]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 06:30:05 user nova-compute[74295]:   <vcpu placement='static'>1</vcpu>
Oct 26 06:30:05 user nova-compute[74295]:   <resource>
Oct 26 06:30:05 user nova-compute[74295]:     <partition>/machine</partition>
Oct 26 06:30:05 user nova-compute[74295]:   </resource>
Oct 26 06:30:05 user nova-compute[74295]:   <sysinfo type='smbios'>
Oct 26 06:30:05 user nova-compute[74295]:     <system>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='version'>0.0.0</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='serial'>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='uuid'>4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</entry>
Oct 26 06:30:05 user nova-compute[74295]:       <entry name='family'>Virtual Machine</entry>
Oct 26 06:30:05 user nova-compute[74295]:     </system>
Oct 26 06:30:05 user nova-compute[74295]:   </sysinfo>
Oct 26 06:30:05 user nova-compute[74295]:   <os>
Oct 26 06:30:05 user nova-compute[74295]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 06:30:05 user nova-compute[74295]:     <boot dev='hd'/>
Oct 26 06:30:05 user nova-compute[74295]:     <smbios mode='sysinfo'/>
Oct 26 06:30:05 user nova-compute[74295]:   </os>
Oct 26 06:30:05 user nova-compute[74295]:   <features>
Oct 26 06:30:05 user nova-compute[74295]:     <acpi/>
Oct 26 06:30:05 user nova-compute[74295]:     <apic/>
Oct 26 06:30:05 user nova-compute[74295]:     <vmcoreinfo state='on'/>
Oct 26 06:30:05 user nova-compute[74295]:   </features>
Oct 26 06:30:05 user nova-compute[74295]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 06:30:05 user nova-compute[74295]:     <model fallback='forbid'>Nehalem</model>
Oct 26 06:30:05 user nova-compute[74295]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 06:30:05 user nova-compute[74295]:     <feature policy='require' name='vme'/>
Oct 26 06:30:05 user nova-compute[74295]:     <feature policy='require' name='x2apic'/>
Oct 26 06:30:05 user nova-compute[74295]:     <feature policy='require' name='hypervisor'/>
Oct 26 06:30:05 user nova-compute[74295]:   </cpu>
Oct 26 06:30:05 user nova-compute[74295]:   <clock offset='utc'>
Oct 26 06:30:05 user nova-compute[74295]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 06:30:05 user nova-compute[74295]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 06:30:05 user nova-compute[74295]:     <timer name='hpet' present='no'/>
Oct 26 06:30:05 user nova-compute[74295]:   </clock>
Oct 26 06:30:05 user nova-compute[74295]:   <on_poweroff>destroy</on_poweroff>
Oct 26 06:30:05 user nova-compute[74295]:   <on_reboot>restart</on_reboot>
Oct 26 06:30:05 user nova-compute[74295]:   <on_crash>destroy</on_crash>
Oct 26 06:30:05 user nova-compute[74295]:   <devices>
Oct 26 06:30:05 user nova-compute[74295]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 06:30:05 user nova-compute[74295]:     <disk type='file' device='disk'>
Oct 26 06:30:05 user nova-compute[74295]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 06:30:05 user nova-compute[74295]:       <source file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk' index='2'/>
Oct 26 06:30:05 user nova-compute[74295]:       <backingStore type='file' index='3'>
Oct 26 06:30:05 user nova-compute[74295]:         <format type='raw'/>
Oct 26 06:30:05 user nova-compute[74295]:         <source file='/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799'/>
Oct 26 06:30:05 user nova-compute[74295]:         <backingStore/>
Oct 26 06:30:05 user nova-compute[74295]:       </backingStore>
Oct 26 06:30:05 user nova-compute[74295]:       <target dev='vda' bus='virtio'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='virtio-disk0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </disk>
Oct 26 06:30:05 user nova-compute[74295]:     <disk type='file' device='cdrom'>
Oct 26 06:30:05 user nova-compute[74295]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 06:30:05 user nova-compute[74295]:       <source file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk.config' index='1'/>
Oct 26 06:30:05 user nova-compute[74295]:       <backingStore/>
Oct 26 06:30:05 user nova-compute[74295]:       <target dev='hda' bus='ide'/>
Oct 26 06:30:05 user nova-compute[74295]:       <readonly/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='ide0-0-0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </disk>
Oct 26 06:30:05 user nova-compute[74295]:     <controller type='usb' index='0' model='none'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='usb'/>
Oct 26 06:30:05 user nova-compute[74295]:     </controller>
Oct 26 06:30:05 user nova-compute[74295]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='pci.0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </controller>
Oct 26 06:30:05 user nova-compute[74295]:     <controller type='ide' index='0'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='ide'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 06:30:05 user nova-compute[74295]:     </controller>
Oct 26 06:30:05 user nova-compute[74295]:     <interface type='ethernet'>
Oct 26 06:30:05 user nova-compute[74295]:       <mac address='fa:16:3e:60:fd:c1'/>
Oct 26 06:30:05 user nova-compute[74295]:       <target dev='tapba4ab381-01'/>
Oct 26 06:30:05 user nova-compute[74295]:       <model type='virtio'/>
Oct 26 06:30:05 user nova-compute[74295]:       <mtu size='1442'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='net0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </interface>
Oct 26 06:30:05 user nova-compute[74295]:     <serial type='pty'>
Oct 26 06:30:05 user nova-compute[74295]:       <source path='/dev/pts/8'/>
Oct 26 06:30:05 user nova-compute[74295]:       <log file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log' append='off'/>
Oct 26 06:30:05 user nova-compute[74295]:       <target type='isa-serial' port='0'>
Oct 26 06:30:05 user nova-compute[74295]:         <model name='isa-serial'/>
Oct 26 06:30:05 user nova-compute[74295]:       </target>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='serial0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </serial>
Oct 26 06:30:05 user nova-compute[74295]:     <console type='pty' tty='/dev/pts/8'>
Oct 26 06:30:05 user nova-compute[74295]:       <source path='/dev/pts/8'/>
Oct 26 06:30:05 user nova-compute[74295]:       <log file='/opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/console.log' append='off'/>
Oct 26 06:30:05 user nova-compute[74295]:       <target type='serial' port='0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='serial0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </console>
Oct 26 06:30:05 user nova-compute[74295]:     <input type='mouse' bus='ps2'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='input0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </input>
Oct 26 06:30:05 user nova-compute[74295]:     <input type='keyboard' bus='ps2'>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='input1'/>
Oct 26 06:30:05 user nova-compute[74295]:     </input>
Oct 26 06:30:05 user nova-compute[74295]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 26 06:30:05 user nova-compute[74295]:       <listen type='address' address='0.0.0.0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </graphics>
Oct 26 06:30:05 user nova-compute[74295]:     <audio id='1' type='none'/>
Oct 26 06:30:05 user nova-compute[74295]:     <video>
Oct 26 06:30:05 user nova-compute[74295]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='video0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </video>
Oct 26 06:30:05 user nova-compute[74295]:     <memballoon model='virtio'>
Oct 26 06:30:05 user nova-compute[74295]:       <stats period='10'/>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='balloon0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </memballoon>
Oct 26 06:30:05 user nova-compute[74295]:     <rng model='virtio'>
Oct 26 06:30:05 user nova-compute[74295]:       <backend model='random'>/dev/urandom</backend>
Oct 26 06:30:05 user nova-compute[74295]:       <alias name='rng0'/>
Oct 26 06:30:05 user nova-compute[74295]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 06:30:05 user nova-compute[74295]:     </rng>
Oct 26 06:30:05 user nova-compute[74295]:   </devices>
Oct 26 06:30:05 user nova-compute[74295]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 06:30:05 user nova-compute[74295]:     <label>libvirt-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</label>
Oct 26 06:30:05 user nova-compute[74295]:     <imagelabel>libvirt-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08</imagelabel>
Oct 26 06:30:05 user nova-compute[74295]:   </seclabel>
Oct 26 06:30:05 user nova-compute[74295]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 06:30:05 user nova-compute[74295]:     <label>+64055:+108</label>
Oct 26 06:30:05 user nova-compute[74295]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 06:30:05 user nova-compute[74295]:   </seclabel>
Oct 26 06:30:05 user nova-compute[74295]: </domain>
Oct 26 06:30:05 user nova-compute[74295]:  {{(pid=74295) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 06:30:05 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Detaching interface fa:16:3e:f6:7f:54 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap728a6d93-53' not found.
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235576379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235576379',id=9,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWyzCZKNfN++RdhZ7vCbqyQNIYdI761TFaG7JRpiZgjn40o6GYxEOHQNTFN5QLWKwFHwjbW8YmEMF7M/0RDutFK5QOejaU2AoitJ/iwiYQOMZr1KHRuqURWMhnnUXc/g==',key_name='tempest-keypair-916215385',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5684b5893b604af484029883dbf5132b',ramdisk_id='',reservation_id='r-oovp6ig1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1270357865',owner_user_name='tempest-TaggedAttachmentsTest-1270357865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='620a58893e6f41a1ae1e57f672427d61',uuid=4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.network.os_vif_util [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] Converting VIF {"id": "728a6d93-5334-466c-ae8c-42a7b45d7383", "address": "fa:16:3e:f6:7f:54", "network": {"id": "902f1415-d568-43e8-a12c-8c57a21b641d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-887629603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728a6d93-53", "ovs_interfaceid": "728a6d93-5334-466c-ae8c-42a7b45d7383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.network.os_vif_util [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG os_vif [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap728a6d93-53, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:30:05 user nova-compute[74295]: INFO os_vif [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7f:54,bridge_name='br-int',has_traffic_filtering=True,id=728a6d93-5334-466c-ae8c-42a7b45d7383,network=Network(902f1415-d568-43e8-a12c-8c57a21b641d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728a6d93-53')
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [req-ed2c811d-a485-4944-9aa2-5e95a39d78a7 req-4090201f-1dc8-4857-be7f-90c7d3f8e100 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:30:05 user nova-compute[74295]:   <nova:package version="0.0.0"/>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:name>tempest-device-tagging-server-235576379</nova:name>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:creationTime>2023-10-26 06:30:05</nova:creationTime>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:flavor name="m1.tiny">
Oct 26 06:30:05 user nova-compute[74295]:     <nova:memory>512</nova:memory>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:disk>1</nova:disk>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:swap>0</nova:swap>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:vcpus>1</nova:vcpus>
Oct 26 06:30:05 user nova-compute[74295]:   </nova:flavor>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:owner>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:user uuid="620a58893e6f41a1ae1e57f672427d61">tempest-TaggedAttachmentsTest-1270357865-project-member</nova:user>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:project uuid="5684b5893b604af484029883dbf5132b">tempest-TaggedAttachmentsTest-1270357865</nova:project>
Oct 26 06:30:05 user nova-compute[74295]:   </nova:owner>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:30:05 user nova-compute[74295]:   <nova:ports>
Oct 26 06:30:05 user nova-compute[74295]:     <nova:port uuid="ba4ab381-015f-4485-8618-e7c48a5f0d26">
Oct 26 06:30:05 user nova-compute[74295]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:30:05 user nova-compute[74295]:     </nova:port>
Oct 26 06:30:05 user nova-compute[74295]:   </nova:ports>
Oct 26 06:30:05 user nova-compute[74295]: </nova:instance>
Oct 26 06:30:05 user nova-compute[74295]:  {{(pid=74295) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updating instance_info_cache with network_info: [{"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.328s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Releasing lock "refresh_cache-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-91a0553b-0494-46fd-a93a-1b72bcc151a9 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "interface-4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-728a6d93-5334-466c-ae8c-42a7b45d7383" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.325s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:30:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:30:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG nova.policy [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52ce37b4013c423ab2b3ee18de59268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b81f5ea6494b28bae66e491d00224a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:30:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Creating image(s)
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "/opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "/opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "/opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.203s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.220s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk 1073741824" returned: 0 in 0.058s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.242s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.network.neutron [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Successfully created port: fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Cannot resize image /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Ensure instance console log exists: /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:30:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cf010631-119f-42b0-a356-a645b27e4081] Instance spawned successfully.
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-8db66ee3-28fa-4ade-8b3f-522636146e0d req-e4031034-9914-4816-81e9-81e32b918003 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8db66ee3-28fa-4ade-8b3f-522636146e0d req-e4031034-9914-4816-81e9-81e32b918003 service nova] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8db66ee3-28fa-4ade-8b3f-522636146e0d req-e4031034-9914-4816-81e9-81e32b918003 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8db66ee3-28fa-4ade-8b3f-522636146e0d req-e4031034-9914-4816-81e9-81e32b918003 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-8db66ee3-28fa-4ade-8b3f-522636146e0d req-e4031034-9914-4816-81e9-81e32b918003 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] No waiting events found dispatching network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:07 user nova-compute[74295]: WARNING nova.compute.manager [req-8db66ee3-28fa-4ade-8b3f-522636146e0d req-e4031034-9914-4816-81e9-81e32b918003 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received unexpected event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 for instance with vm_state building and task_state spawning.
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:07 user nova-compute[74295]: INFO nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Took 6.94 seconds to spawn the instance on the hypervisor.
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.network.neutron [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Successfully updated port: fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-d0564632-4519-4e18-a4d7-4bb1fb000507 req-17a7fd76-8248-4529-bcd5-a194c5496c19 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received event network-changed-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-d0564632-4519-4e18-a4d7-4bb1fb000507 req-17a7fd76-8248-4529-bcd5-a194c5496c19 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Refreshing instance network info cache due to event network-changed-fc3fa6ad-7873-40a2-98cb-0732397e2450. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d0564632-4519-4e18-a4d7-4bb1fb000507 req-17a7fd76-8248-4529-bcd5-a194c5496c19 service nova] Acquiring lock "refresh_cache-1229385f-194e-482e-ac54-ca9cc2591edd" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d0564632-4519-4e18-a4d7-4bb1fb000507 req-17a7fd76-8248-4529-bcd5-a194c5496c19 service nova] Acquired lock "refresh_cache-1229385f-194e-482e-ac54-ca9cc2591edd" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-d0564632-4519-4e18-a4d7-4bb1fb000507 req-17a7fd76-8248-4529-bcd5-a194c5496c19 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Refreshing network info cache for port fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:30:07 user nova-compute[74295]: INFO nova.compute.manager [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Took 8.33 seconds to build instance.
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "refresh_cache-1229385f-194e-482e-ac54-ca9cc2591edd" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6de0846a-a4e2-4a6a-a794-ac65651fbd47 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.456s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-d0564632-4519-4e18-a4d7-4bb1fb000507 req-17a7fd76-8248-4529-bcd5-a194c5496c19 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.network.neutron [req-d0564632-4519-4e18-a4d7-4bb1fb000507 req-17a7fd76-8248-4529-bcd5-a194c5496c19 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d0564632-4519-4e18-a4d7-4bb1fb000507 req-17a7fd76-8248-4529-bcd5-a194c5496c19 service nova] Releasing lock "refresh_cache-1229385f-194e-482e-ac54-ca9cc2591edd" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquired lock "refresh_cache-1229385f-194e-482e-ac54-ca9cc2591edd" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Updating instance_info_cache with network_info: [{"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Releasing lock "refresh_cache-1229385f-194e-482e-ac54-ca9cc2591edd" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Instance network_info: |[{"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Start _get_guest_xml network_info=[{"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:30:08 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:30:08 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-812741977',display_name='tempest-TestServerVolumeAttachmentScenario-server-812741977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-812741977',id=15,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNCHQll3vU578k7buY5N87dR8esbbI8tbMM76gVYJ8dnm2CmKZ2TG/5sZsc71b77d5Lq36TaBdJPnHSchG5/A9mXcp6up26ThX4ekGLofibsgNS8RdJ4F4OUpYXzKqx1w==',key_name='tempest-keypair-635302849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6b81f5ea6494b28bae66e491d00224a',ramdisk_id='',reservation_id='r-qv4zkapp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2131838263',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2131838263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52ce37b4013c423ab2b3ee18de59268d',uuid=1229385f-194e-482e-ac54-ca9cc2591edd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Converting VIF {"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:eb:54,bridge_name='br-int',has_traffic_filtering=True,id=fc3fa6ad-7873-40a2-98cb-0732397e2450,network=Network(2e14910d-21e1-4734-b4ad-04167d93510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3fa6ad-78') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.objects.instance [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lazy-loading 'pci_devices' on Instance uuid 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:30:08 user nova-compute[74295]:   <uuid>1229385f-194e-482e-ac54-ca9cc2591edd</uuid>
Oct 26 06:30:08 user nova-compute[74295]:   <name>instance-0000000f</name>
Oct 26 06:30:08 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:30:08 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:30:08 user nova-compute[74295]:   <metadata>
Oct 26 06:30:08 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:30:08 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:30:08 user nova-compute[74295]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-812741977</nova:name>
Oct 26 06:30:08 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:30:08</nova:creationTime>
Oct 26 06:30:08 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:30:08 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:30:08 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:30:08 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:30:08 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:30:08 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:30:08 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:30:08 user nova-compute[74295]:       <nova:owner>
Oct 26 06:30:08 user nova-compute[74295]:         <nova:user uuid="52ce37b4013c423ab2b3ee18de59268d">tempest-TestServerVolumeAttachmentScenario-2131838263-project-member</nova:user>
Oct 26 06:30:08 user nova-compute[74295]:         <nova:project uuid="f6b81f5ea6494b28bae66e491d00224a">tempest-TestServerVolumeAttachmentScenario-2131838263</nova:project>
Oct 26 06:30:08 user nova-compute[74295]:       </nova:owner>
Oct 26 06:30:08 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:30:08 user nova-compute[74295]:       <nova:ports>
Oct 26 06:30:08 user nova-compute[74295]:         <nova:port uuid="fc3fa6ad-7873-40a2-98cb-0732397e2450">
Oct 26 06:30:08 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 06:30:08 user nova-compute[74295]:         </nova:port>
Oct 26 06:30:08 user nova-compute[74295]:       </nova:ports>
Oct 26 06:30:08 user nova-compute[74295]:     </nova:instance>
Oct 26 06:30:08 user nova-compute[74295]:   </metadata>
Oct 26 06:30:08 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:30:08 user nova-compute[74295]:     <system>
Oct 26 06:30:08 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:30:08 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:30:08 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:30:08 user nova-compute[74295]:       <entry name="serial">1229385f-194e-482e-ac54-ca9cc2591edd</entry>
Oct 26 06:30:08 user nova-compute[74295]:       <entry name="uuid">1229385f-194e-482e-ac54-ca9cc2591edd</entry>
Oct 26 06:30:08 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:30:08 user nova-compute[74295]:     </system>
Oct 26 06:30:08 user nova-compute[74295]:   </sysinfo>
Oct 26 06:30:08 user nova-compute[74295]:   <os>
Oct 26 06:30:08 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:30:08 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:30:08 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:30:08 user nova-compute[74295]:   </os>
Oct 26 06:30:08 user nova-compute[74295]:   <features>
Oct 26 06:30:08 user nova-compute[74295]:     <acpi/>
Oct 26 06:30:08 user nova-compute[74295]:     <apic/>
Oct 26 06:30:08 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:30:08 user nova-compute[74295]:   </features>
Oct 26 06:30:08 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:30:08 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:30:08 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:30:08 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:30:08 user nova-compute[74295]:   </clock>
Oct 26 06:30:08 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:30:08 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:30:08 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:30:08 user nova-compute[74295]:   </cpu>
Oct 26 06:30:08 user nova-compute[74295]:   <devices>
Oct 26 06:30:08 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:30:08 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:30:08 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk"/>
Oct 26 06:30:08 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:30:08 user nova-compute[74295]:     </disk>
Oct 26 06:30:08 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:30:08 user nova-compute[74295]:       <mac address="fa:16:3e:0d:eb:54"/>
Oct 26 06:30:08 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:30:08 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:30:08 user nova-compute[74295]:       <target dev="tapfc3fa6ad-78"/>
Oct 26 06:30:08 user nova-compute[74295]:     </interface>
Oct 26 06:30:08 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:30:08 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/console.log" append="off"/>
Oct 26 06:30:08 user nova-compute[74295]:     </serial>
Oct 26 06:30:08 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:30:08 user nova-compute[74295]:     <video>
Oct 26 06:30:08 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:30:08 user nova-compute[74295]:     </video>
Oct 26 06:30:08 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:30:08 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:30:08 user nova-compute[74295]:     </rng>
Oct 26 06:30:08 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:30:08 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:30:08 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:30:08 user nova-compute[74295]:     </memballoon>
Oct 26 06:30:08 user nova-compute[74295]:   </devices>
Oct 26 06:30:08 user nova-compute[74295]: </domain>
Oct 26 06:30:08 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-812741977',display_name='tempest-TestServerVolumeAttachmentScenario-server-812741977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-812741977',id=15,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNCHQll3vU578k7buY5N87dR8esbbI8tbMM76gVYJ8dnm2CmKZ2TG/5sZsc71b77d5Lq36TaBdJPnHSchG5/A9mXcp6up26ThX4ekGLofibsgNS8RdJ4F4OUpYXzKqx1w==',key_name='tempest-keypair-635302849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6b81f5ea6494b28bae66e491d00224a',ramdisk_id='',reservation_id='r-qv4zkapp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2131838263',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2131838263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52ce37b4013c423ab2b3ee18de59268d',uuid=1229385f-194e-482e-ac54-ca9cc2591edd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Converting VIF {"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:eb:54,bridge_name='br-int',has_traffic_filtering=True,id=fc3fa6ad-7873-40a2-98cb-0732397e2450,network=Network(2e14910d-21e1-4734-b4ad-04167d93510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3fa6ad-78') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG os_vif [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:eb:54,bridge_name='br-int',has_traffic_filtering=True,id=fc3fa6ad-7873-40a2-98cb-0732397e2450,network=Network(2e14910d-21e1-4734-b4ad-04167d93510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3fa6ad-78') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b59bcdd-d1e3-596c-8665-1f6328b3ffe7', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:09 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:30:09 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7470MB free_disk=25.476566314697266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc3fa6ad-78, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc3fa6ad-78, col_values=(('qos', UUID('9d50854c-3d05-4c04-948d-dce19772d2f1')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc3fa6ad-78, col_values=(('external_ids', {'iface-id': 'fc3fa6ad-7873-40a2-98cb-0732397e2450', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:eb:54', 'vm-uuid': '1229385f-194e-482e-ac54-ca9cc2591edd'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:09 user nova-compute[74295]: INFO os_vif [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:eb:54,bridge_name='br-int',has_traffic_filtering=True,id=fc3fa6ad-7873-40a2-98cb-0732397e2450,network=Network(2e14910d-21e1-4734-b4ad-04167d93510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3fa6ad-78')
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] No VIF found with MAC fa:16:3e:0d:eb:54, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 88335730-9d04-4614-8c24-f0c3957418f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance e86416be-82cc-4ab5-9d48-2173ea952bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a779935e-152e-4223-9a6a-166c9efc490a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 48f22cde-4b90-43de-aba1-968afce2ddce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cf010631-119f-42b0-a356-a645b27e4081 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1229385f-194e-482e-ac54-ca9cc2591edd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:30:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:30:10 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:30:10 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:30:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:30:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.836s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-7677b8d7-54d8-4292-a822-81fb98303721 req-8fef4e83-7600-49c7-b962-45f13ff6f9f7 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received event network-vif-plugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7677b8d7-54d8-4292-a822-81fb98303721 req-8fef4e83-7600-49c7-b962-45f13ff6f9f7 service nova] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7677b8d7-54d8-4292-a822-81fb98303721 req-8fef4e83-7600-49c7-b962-45f13ff6f9f7 service nova] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7677b8d7-54d8-4292-a822-81fb98303721 req-8fef4e83-7600-49c7-b962-45f13ff6f9f7 service nova] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-7677b8d7-54d8-4292-a822-81fb98303721 req-8fef4e83-7600-49c7-b962-45f13ff6f9f7 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] No waiting events found dispatching network-vif-plugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:11 user nova-compute[74295]: WARNING nova.compute.manager [req-7677b8d7-54d8-4292-a822-81fb98303721 req-8fef4e83-7600-49c7-b962-45f13ff6f9f7 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received unexpected event network-vif-plugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 for instance with vm_state building and task_state spawning.
Oct 26 06:30:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:12 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:12 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:12 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:12 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-1ff0b72c-b34e-45f1-8d2a-505e9e822e01 req-7643904b-fb95-435b-9c80-2e076bb07a15 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received event network-vif-plugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1ff0b72c-b34e-45f1-8d2a-505e9e822e01 req-7643904b-fb95-435b-9c80-2e076bb07a15 service nova] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1ff0b72c-b34e-45f1-8d2a-505e9e822e01 req-7643904b-fb95-435b-9c80-2e076bb07a15 service nova] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1ff0b72c-b34e-45f1-8d2a-505e9e822e01 req-7643904b-fb95-435b-9c80-2e076bb07a15 service nova] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-1ff0b72c-b34e-45f1-8d2a-505e9e822e01 req-7643904b-fb95-435b-9c80-2e076bb07a15 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] No waiting events found dispatching network-vif-plugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:13 user nova-compute[74295]: WARNING nova.compute.manager [req-1ff0b72c-b34e-45f1-8d2a-505e9e822e01 req-7643904b-fb95-435b-9c80-2e076bb07a15 service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received unexpected event network-vif-plugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 for instance with vm_state building and task_state spawning.
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:30:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Instance spawned successfully.
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:30:13 user nova-compute[74295]: INFO nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Took 7.55 seconds to spawn the instance on the hypervisor.
Oct 26 06:30:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:30:13 user nova-compute[74295]: INFO nova.compute.manager [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Took 9.45 seconds to build instance.
Oct 26 06:30:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-059f9c16-253d-4788-8e1d-ee16e439e65a tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.590s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.009s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:16 user nova-compute[74295]: INFO nova.compute.manager [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Terminating instance
Oct 26 06:30:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-291f46d4-a487-4d99-a839-3e7f8ebb0703 req-6587a53c-b356-4f7e-b6a4-4b63da1cd1a8 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received event network-vif-unplugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-291f46d4-a487-4d99-a839-3e7f8ebb0703 req-6587a53c-b356-4f7e-b6a4-4b63da1cd1a8 service nova] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-291f46d4-a487-4d99-a839-3e7f8ebb0703 req-6587a53c-b356-4f7e-b6a4-4b63da1cd1a8 service nova] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-291f46d4-a487-4d99-a839-3e7f8ebb0703 req-6587a53c-b356-4f7e-b6a4-4b63da1cd1a8 service nova] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-291f46d4-a487-4d99-a839-3e7f8ebb0703 req-6587a53c-b356-4f7e-b6a4-4b63da1cd1a8 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] No waiting events found dispatching network-vif-unplugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-291f46d4-a487-4d99-a839-3e7f8ebb0703 req-6587a53c-b356-4f7e-b6a4-4b63da1cd1a8 service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received event network-vif-unplugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:30:17 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Instance destroyed successfully.
Oct 26 06:30:17 user nova-compute[74295]: DEBUG nova.objects.instance [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lazy-loading 'resources' on Instance uuid e86416be-82cc-4ab5-9d48-2173ea952bce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-781135046',display_name='tempest-VolumesAssistedSnapshotsTest-server-781135046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-781135046',id=10,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9VcYHexqhDvuIMQ2SCyp3YBVjg67WKScx/mgNA994EK4DYueP8pviBEAKnI9TLy9QlAmtV1V79X/uF5TJx7DSmqu86MKjqO6veViG/RfIV1rNNZR7lvBvKWvTzHp0HKg==',key_name='tempest-keypair-654166439',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:27:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46e5ffd74d124bf3806d9adabd96551e',ramdisk_id='',reservation_id='r-ew1hfpr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-591115203',owner_user_name='tempest-VolumesAssistedSnapshotsTest-591115203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf6cd88c450745f4b558791db9a54b50',uuid=e86416be-82cc-4ab5-9d48-2173ea952bce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Converting VIF {"id": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "address": "fa:16:3e:90:90:2d", "network": {"id": "0afe623f-03fa-4121-b2f2-89872565fe9c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-672826021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e5ffd74d124bf3806d9adabd96551e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6c064c-37", "ovs_interfaceid": "7a6c064c-37ef-4322-90dc-a2113537cfb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:90:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a6c064c-37ef-4322-90dc-a2113537cfb5,network=Network(0afe623f-03fa-4121-b2f2-89872565fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6c064c-37') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG os_vif [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:90:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a6c064c-37ef-4322-90dc-a2113537cfb5,network=Network(0afe623f-03fa-4121-b2f2-89872565fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6c064c-37') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a6c064c-37, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3738a158-13c2-456b-b749-e5481bdbf965) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:17 user nova-compute[74295]: INFO os_vif [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:90:2d,bridge_name='br-int',has_traffic_filtering=True,id=7a6c064c-37ef-4322-90dc-a2113537cfb5,network=Network(0afe623f-03fa-4121-b2f2-89872565fe9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6c064c-37')
Oct 26 06:30:17 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Deleting instance files /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce_del
Oct 26 06:30:17 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Deletion of /opt/stack/data/nova/instances/e86416be-82cc-4ab5-9d48-2173ea952bce_del complete
Oct 26 06:30:17 user nova-compute[74295]: INFO nova.compute.manager [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 26 06:30:17 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:30:17 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:30:18 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:18 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Took 1.13 seconds to deallocate network for instance.
Oct 26 06:30:18 user nova-compute[74295]: DEBUG nova.compute.manager [req-a14f6c72-12f4-4046-ab43-9b8789e6bf66 req-6b4e07ea-df6d-4998-9ab3-3dac55504b3c service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received event network-vif-deleted-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:18 user nova-compute[74295]: DEBUG nova.compute.manager [req-7d8000c7-36ce-4276-b4d7-7dba4d5506b1 req-05165e31-1402-43f7-9994-a4d0897c3eea service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received event network-vif-plugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7d8000c7-36ce-4276-b4d7-7dba4d5506b1 req-05165e31-1402-43f7-9994-a4d0897c3eea service nova] Acquiring lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7d8000c7-36ce-4276-b4d7-7dba4d5506b1 req-05165e31-1402-43f7-9994-a4d0897c3eea service nova] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7d8000c7-36ce-4276-b4d7-7dba4d5506b1 req-05165e31-1402-43f7-9994-a4d0897c3eea service nova] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:18 user nova-compute[74295]: DEBUG nova.compute.manager [req-7d8000c7-36ce-4276-b4d7-7dba4d5506b1 req-05165e31-1402-43f7-9994-a4d0897c3eea service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] No waiting events found dispatching network-vif-plugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:18 user nova-compute[74295]: WARNING nova.compute.manager [req-7d8000c7-36ce-4276-b4d7-7dba4d5506b1 req-05165e31-1402-43f7-9994-a4d0897c3eea service nova] [instance: e86416be-82cc-4ab5-9d48-2173ea952bce] Received unexpected event network-vif-plugged-7a6c064c-37ef-4322-90dc-a2113537cfb5 for instance with vm_state deleted and task_state None.
Oct 26 06:30:19 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:30:19 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:30:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.659s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:19 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Deleted allocations for instance e86416be-82cc-4ab5-9d48-2173ea952bce
Oct 26 06:30:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-892456b2-6d10-4010-9e14-9933dabb18cf tempest-VolumesAssistedSnapshotsTest-591115203 tempest-VolumesAssistedSnapshotsTest-591115203-project-member] Lock "e86416be-82cc-4ab5-9d48-2173ea952bce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.106s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:30:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:30:22 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:30:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:30:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:30:22 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:30:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:30:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:30:22 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:30:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4698ff-8341-4b24-b9b3-bc15bd025495]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:30:22 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbae216-24d3-4312-b260-769440804d64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b] added
Oct 26 06:30:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9491b1-dc2b-4d00-9d83-b98c16458a55]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40e6464-94f7-4bff-95a2-1c0582ab24f6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFgsenmy {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFgsenmy" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[07518076-bd34-49bb-98c3-5b07fc852394]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RFgsenmy'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d64968a-9574-464a-b8c3-d920501d78d4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[46833b7c-9780-4762-9afd-0b2219d56351]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8b2291-24e2-46ec-99aa-7cad9b440ad0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]
Oct 26 06:30:23 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.
Oct 26 06:30:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40ad7e-ed25-400f-b9cb-3a92399cf08b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[795b9693-35d0-43a2-bca7-809df475e26c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:23 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bebbc8-2407-4bd4-b684-a47681c7797d]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:30:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:30:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:30:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23661646561646436', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:30:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661646561646436', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:30:24 user nova-compute[74295]: DEBUG nova.objects.instance [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lazy-loading 'flavor' on Instance uuid 775d5e2e-95a6-4a86-b6f3-ce96735378d9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:30:24 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:30:24 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:30:24 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:30:24 user nova-compute[74295]:   <serial>0f212bc3-b89c-4588-9186-df7b86c44e6b</serial>
Oct 26 06:30:24 user nova-compute[74295]: </disk>
Oct 26 06:30:24 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:30:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:30:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:30:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] No VIF found with MAC fa:16:3e:ad:4f:d9, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:30:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-554b6b95-3b89-4732-bc7e-99f463b928c4 tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.560s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Stashing vm_state: active {{(pid=74295) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 06:30:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:30:28 user nova-compute[74295]: INFO nova.compute.claims [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Claim successful on node user
Oct 26 06:30:28 user nova-compute[74295]: INFO nova.compute.resource_tracker [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating resource usage from migration 288bbde7-fba4-4018-867d-86cae276705e
Oct 26 06:30:28 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:30:28 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:30:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.538s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:28 user nova-compute[74295]: INFO nova.compute.manager [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Migrating
Oct 26 06:30:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:28 user nova-compute[74295]: INFO nova.compute.rpcapi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 26 06:30:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquired lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:28 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:30:29 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance_info_cache with network_info: [{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Releasing lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Starting migrate_disk_and_power_off {{(pid=74295) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-07ad3036-c56a-4945-a41d-8093f782bbf3 req-4b828a12-608b-4993-a62f-ec77b9b4f870 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-unplugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-07ad3036-c56a-4945-a41d-8093f782bbf3 req-4b828a12-608b-4993-a62f-ec77b9b4f870 service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-07ad3036-c56a-4945-a41d-8093f782bbf3 req-4b828a12-608b-4993-a62f-ec77b9b4f870 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-07ad3036-c56a-4945-a41d-8093f782bbf3 req-4b828a12-608b-4993-a62f-ec77b9b4f870 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-07ad3036-c56a-4945-a41d-8093f782bbf3 req-4b828a12-608b-4993-a62f-ec77b9b4f870 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-unplugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:30 user nova-compute[74295]: WARNING nova.compute.manager [req-07ad3036-c56a-4945-a41d-8093f782bbf3 req-4b828a12-608b-4993-a62f-ec77b9b4f870 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-unplugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state active and task_state resize_migrating.
Oct 26 06:30:30 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance destroyed successfully.
Oct 26 06:30:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-97936637',display_name='tempest-ServerActionsTestOtherB-server-97936637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-97936637',id=4,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmm1IaoBoVd8Hkv3gtx/L78lFPzYOW0A2Qqc9FfseOv4MiM64O4tVX1rCM39AF+LH46KHkGVTicvdWviQLc+ppyTXiLGRvBGUpaFnTBwUaROd5zinEiEdd3gXRLbgwTBg==',key_name='tempest-keypair-393220372',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd8a2b9f8cce49d4985549fd42dc1e8a',ramdisk_id='',reservation_id='r-cmxn1myp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-406693711',owner_user_name='tempest-ServerActionsTestOtherB-406693711-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e44a6886b2b478dbca031edd15a9a6f',uuid=775d5e2e-95a6-4a86-b6f3-ce96735378d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971519128-network", "vif_mac": "fa:16:3e:ad:4f:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converting VIF {"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971519128-network", "vif_mac": "fa:16:3e:ad:4f:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG os_vif [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0e3fe7f-b7, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1205f2da-414a-47fe-8bf3-3165ca62555c) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:30 user nova-compute[74295]: INFO os_vif [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7')
Oct 26 06:30:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-109ea008-bbe9-4bb9-8006-ddf788258979 req-45ab8ea2-e82e-4ef6-a192-02ae50d2767f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-changed-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-109ea008-bbe9-4bb9-8006-ddf788258979 req-45ab8ea2-e82e-4ef6-a192-02ae50d2767f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing instance network info cache due to event network-changed-41528c15-0199-45b8-a577-d8c4bd0ecb82. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-109ea008-bbe9-4bb9-8006-ddf788258979 req-45ab8ea2-e82e-4ef6-a192-02ae50d2767f service nova] Acquiring lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-109ea008-bbe9-4bb9-8006-ddf788258979 req-45ab8ea2-e82e-4ef6-a192-02ae50d2767f service nova] Acquired lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG nova.network.neutron [req-109ea008-bbe9-4bb9-8006-ddf788258979 req-45ab8ea2-e82e-4ef6-a192-02ae50d2767f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Refreshing network info cache for port 41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:30:30 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:30:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:30:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b18429f-4572-4903-b7d7-5dc989136352]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:30:31 user nova-compute[74295]: No targets found.
Oct 26 06:30:31 user nova-compute[74295]: iSNS:
Oct 26 06:30:31 user nova-compute[74295]: No targets found.
Oct 26 06:30:31 user nova-compute[74295]: STATIC:
Oct 26 06:30:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77
Oct 26 06:30:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150
Oct 26 06:30:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b
Oct 26 06:30:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:30:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:30:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:31 user nova-compute[74295]: FIRMWARE:
Oct 26 06:30:31 user nova-compute[74295]: No targets found.
Oct 26 06:30:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:30:31 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:30:31 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa2e5d6-f296-445f-91c2-e06ef29cfb1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5e05d0-0993-49b0-b45f-551e2607b2e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:31 user nova-compute[74295]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:30:31 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:30:31 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:31 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:31 user nova-compute[74295]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:30:31 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:30:31 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:31 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac18f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b4da73-1046-4de2-8450-dc3103266a73]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac05dc9-26ba-40fe-b578-e1530181e5d7]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c5893-2d9c-4627-829c-67728a2b43d9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0791fc99-d4aa-43f7-a1c5-86c7fd019107]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c51676f-36fe-4488-bcc6-34e3f68a17bc]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6137f64f-0b2b-45b8-9358-33ed19958d79]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]
Oct 26 06:30:31 user nova-compute[74295]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.
Oct 26 06:30:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ac601e-230f-4faf-928b-8e6b4e8d787a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] <== disconnect_volume: return (371ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG nova.network.neutron [req-109ea008-bbe9-4bb9-8006-ddf788258979 req-45ab8ea2-e82e-4ef6-a192-02ae50d2767f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updated VIF entry in instance network info cache for port 41528c15-0199-45b8-a577-d8c4bd0ecb82. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG nova.network.neutron [req-109ea008-bbe9-4bb9-8006-ddf788258979 req-45ab8ea2-e82e-4ef6-a192-02ae50d2767f service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [{"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-109ea008-bbe9-4bb9-8006-ddf788258979 req-45ab8ea2-e82e-4ef6-a192-02ae50d2767f service nova] Releasing lock "refresh_cache-a779935e-152e-4223-9a6a-166c9efc490a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:30:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9_resize/disk /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-34739839-dbe8-4d5c-90a1-4cc4ff479925 req-b34b0769-5714-48d2-aad7-b8a4c10111cf service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-34739839-dbe8-4d5c-90a1-4cc4ff479925 req-b34b0769-5714-48d2-aad7-b8a4c10111cf service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-34739839-dbe8-4d5c-90a1-4cc4ff479925 req-b34b0769-5714-48d2-aad7-b8a4c10111cf service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-34739839-dbe8-4d5c-90a1-4cc4ff479925 req-b34b0769-5714-48d2-aad7-b8a4c10111cf service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-34739839-dbe8-4d5c-90a1-4cc4ff479925 req-b34b0769-5714-48d2-aad7-b8a4c10111cf service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:32 user nova-compute[74295]: WARNING nova.compute.manager [req-34739839-dbe8-4d5c-90a1-4cc4ff479925 req-b34b0769-5714-48d2-aad7-b8a4c10111cf service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state active and task_state resize_migrating.
Oct 26 06:30:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "cp -r /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9_resize/disk /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk" returned: 0 in 0.634s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9_resize/disk.info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk.info {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "cp -r /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9_resize/disk.info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk.info" returned: 0 in 0.037s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "a779935e-152e-4223-9a6a-166c9efc490a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:33 user nova-compute[74295]: INFO nova.compute.manager [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Terminating instance
Oct 26 06:30:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-869d191e-a9a1-4439-aca3-4b8a28a6b684 req-eab65b45-5c36-434d-8ea7-9b6585ed75cf service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-869d191e-a9a1-4439-aca3-4b8a28a6b684 req-eab65b45-5c36-434d-8ea7-9b6585ed75cf service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-869d191e-a9a1-4439-aca3-4b8a28a6b684 req-eab65b45-5c36-434d-8ea7-9b6585ed75cf service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-869d191e-a9a1-4439-aca3-4b8a28a6b684 req-eab65b45-5c36-434d-8ea7-9b6585ed75cf service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-869d191e-a9a1-4439-aca3-4b8a28a6b684 req-eab65b45-5c36-434d-8ea7-9b6585ed75cf service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-unplugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-869d191e-a9a1-4439-aca3-4b8a28a6b684 req-eab65b45-5c36-434d-8ea7-9b6585ed75cf service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-f6c94b87-3440-43ab-8253-274849c467df req-7f0e96da-50cc-4e14-8f8f-b16f4a445669 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f6c94b87-3440-43ab-8253-274849c467df req-7f0e96da-50cc-4e14-8f8f-b16f4a445669 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f6c94b87-3440-43ab-8253-274849c467df req-7f0e96da-50cc-4e14-8f8f-b16f4a445669 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f6c94b87-3440-43ab-8253-274849c467df req-7f0e96da-50cc-4e14-8f8f-b16f4a445669 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-f6c94b87-3440-43ab-8253-274849c467df req-7f0e96da-50cc-4e14-8f8f-b16f4a445669 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-unplugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-f6c94b87-3440-43ab-8253-274849c467df req-7f0e96da-50cc-4e14-8f8f-b16f4a445669 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-97e4136f-c260-4cea-a337-2e44322bc07e req-a8a46ac4-5d89-4d05-8715-acd0754fbdc2 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-97e4136f-c260-4cea-a337-2e44322bc07e req-a8a46ac4-5d89-4d05-8715-acd0754fbdc2 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-97e4136f-c260-4cea-a337-2e44322bc07e req-a8a46ac4-5d89-4d05-8715-acd0754fbdc2 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-97e4136f-c260-4cea-a337-2e44322bc07e req-a8a46ac4-5d89-4d05-8715-acd0754fbdc2 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-97e4136f-c260-4cea-a337-2e44322bc07e req-a8a46ac4-5d89-4d05-8715-acd0754fbdc2 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-unplugged-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-97e4136f-c260-4cea-a337-2e44322bc07e req-a8a46ac4-5d89-4d05-8715-acd0754fbdc2 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-63f85a57-2470-4601-bc41-05916fda216e for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:34 user nova-compute[74295]: INFO nova.compute.manager [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Terminating instance
Oct 26 06:30:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:30:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Instance destroyed successfully.
Oct 26 06:30:35 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lazy-loading 'resources' on Instance uuid a779935e-152e-4223-9a6a-166c9efc490a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:35 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Instance destroyed successfully.
Oct 26 06:30:35 user nova-compute[74295]: DEBUG nova.objects.instance [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lazy-loading 'resources' on Instance uuid 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:72:02,bridge_name='br-int',has_traffic_filtering=True,id=41528c15-0199-45b8-a577-d8c4bd0ecb82,network=Network(01ec9754-956c-4aa5-b9d1-9daa78e8679f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41528c15-01') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:72:02,bridge_name='br-int',has_traffic_filtering=True,id=41528c15-0199-45b8-a577-d8c4bd0ecb82,network=Network(01ec9754-956c-4aa5-b9d1-9daa78e8679f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41528c15-01') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41528c15-01, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235576379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235576379',id=9,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENWyzCZKNfN++RdhZ7vCbqyQNIYdI761TFaG7JRpiZgjn40o6GYxEOHQNTFN5QLWKwFHwjbW8YmEMF7M/0RDutFK5QOejaU2AoitJ/iwiYQOMZr1KHRuqURWMhnnUXc/g==',key_name='tempest-keypair-916215385',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5684b5893b604af484029883dbf5132b',ramdisk_id='',reservation_id='r-oovp6ig1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1270357865',owner_user_name='tempest-TaggedAttachmentsTest-1270357865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='620a58893e6f41a1ae1e57f672427d61',uuid=4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converting VIF {"id": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "address": "fa:16:3e:60:fd:c1", "network": {"id": "b1dccdc9-7520-47f7-817b-5ab688e91d23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-905838706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5684b5893b604af484029883dbf5132b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4ab381-01", "ovs_interfaceid": "ba4ab381-015f-4485-8618-e7c48a5f0d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:fd:c1,bridge_name='br-int',has_traffic_filtering=True,id=ba4ab381-015f-4485-8618-e7c48a5f0d26,network=Network(b1dccdc9-7520-47f7-817b-5ab688e91d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4ab381-01') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG os_vif [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:fd:c1,bridge_name='br-int',has_traffic_filtering=True,id=ba4ab381-015f-4485-8618-e7c48a5f0d26,network=Network(b1dccdc9-7520-47f7-817b-5ab688e91d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4ab381-01') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4ab381-01, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1f73def-0a30-459f-94eb-94a90eea19af) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffab6612-3157-4d5d-aa96-687ed14fa055) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: INFO os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:72:02,bridge_name='br-int',has_traffic_filtering=True,id=41528c15-0199-45b8-a577-d8c4bd0ecb82,network=Network(01ec9754-956c-4aa5-b9d1-9daa78e8679f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41528c15-01')
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:68:a4,bridge_name='br-int',has_traffic_filtering=True,id=83f63ce6-41bd-4816-b219-ea48b2f8d979,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83f63ce6-41') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:68:a4,bridge_name='br-int',has_traffic_filtering=True,id=83f63ce6-41bd-4816-b219-ea48b2f8d979,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83f63ce6-41') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-e28aa4b2-4ec5-4026-a389-dadfd26e7c61 req-587bd00e-59f8-4f03-a38e-4d1ff34e0882 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e28aa4b2-4ec5-4026-a389-dadfd26e7c61 req-587bd00e-59f8-4f03-a38e-4d1ff34e0882 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e28aa4b2-4ec5-4026-a389-dadfd26e7c61 req-587bd00e-59f8-4f03-a38e-4d1ff34e0882 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e28aa4b2-4ec5-4026-a389-dadfd26e7c61 req-587bd00e-59f8-4f03-a38e-4d1ff34e0882 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-e28aa4b2-4ec5-4026-a389-dadfd26e7c61 req-587bd00e-59f8-4f03-a38e-4d1ff34e0882 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING nova.compute.manager [req-e28aa4b2-4ec5-4026-a389-dadfd26e7c61 req-587bd00e-59f8-4f03-a38e-4d1ff34e0882 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-41528c15-0199-45b8-a577-d8c4bd0ecb82 for instance with vm_state active and task_state deleting.
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83f63ce6-41, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: INFO os_vif [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:fd:c1,bridge_name='br-int',has_traffic_filtering=True,id=ba4ab381-015f-4485-8618-e7c48a5f0d26,network=Network(b1dccdc9-7520-47f7-817b-5ab688e91d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4ab381-01')
Oct 26 06:30:36 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Deleting instance files /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08_del
Oct 26 06:30:36 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Deletion of /opt/stack/data/nova/instances/4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08_del complete
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18a54d51-9f24-410a-996a-ba00b8fa1a19) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: INFO nova.compute.manager [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: INFO os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:68:a4,bridge_name='br-int',has_traffic_filtering=True,id=83f63ce6-41bd-4816-b219-ea48b2f8d979,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83f63ce6-41')
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8a:76,bridge_name='br-int',has_traffic_filtering=True,id=eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb14b7e5-90') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8a:76,bridge_name='br-int',has_traffic_filtering=True,id=eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb14b7e5-90') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb14b7e5-90, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-83f63ce6-41bd-4816-b219-ea48b2f8d979 for instance with vm_state active and task_state deleting.
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-unplugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b for instance with vm_state active and task_state deleting.
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-unplugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-32c78116-87ad-4c2a-82bf-c9a044bbd42c for instance with vm_state active and task_state deleting.
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-unplugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] No waiting events found dispatching network-vif-unplugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-unplugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-plugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Acquiring lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] No waiting events found dispatching network-vif-plugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING nova.compute.manager [req-324a6465-2ee7-4f3a-b78c-54e90510661b req-da263f26-c15d-4b0e-bb56-75453d7fb313 service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received unexpected event network-vif-plugged-ba4ab381-015f-4485-8618-e7c48a5f0d26 for instance with vm_state active and task_state deleting.
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d7639dd-cd63-4a17-af59-949fd88a2925) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: INFO os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8a:76,bridge_name='br-int',has_traffic_filtering=True,id=eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb14b7e5-90')
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "63f85a57-2470-4601-bc41-05916fda216e", "address": "fa:16:3e:16:ca:d5", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63f85a57-24", "ovs_interfaceid": "63f85a57-2470-4601-bc41-05916fda216e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=63f85a57-2470-4601-bc41-05916fda216e,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f85a57-24') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=63f85a57-2470-4601-bc41-05916fda216e,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f85a57-24') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63f85a57-24, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b695b4bd-84b7-4cba-b1f4-6dedb1b0ccd4) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: INFO os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:ca:d5,bridge_name='br-int',has_traffic_filtering=True,id=63f85a57-2470-4601-bc41-05916fda216e,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63f85a57-24')
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:34,bridge_name='br-int',has_traffic_filtering=True,id=38bb9e9c-3925-4527-8232-38b330b64587,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bb9e9c-39') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:34,bridge_name='br-int',has_traffic_filtering=True,id=38bb9e9c-3925-4527-8232-38b330b64587,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bb9e9c-39') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38bb9e9c-39, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=beb56c5c-b009-4062-9035-47d09bf6d8a3) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: INFO os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:34,bridge_name='br-int',has_traffic_filtering=True,id=38bb9e9c-3925-4527-8232-38b330b64587,network=Network(4e3d7600-6161-4f93-81ea-bbcb2b876aa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bb9e9c-39')
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:d1:64,bridge_name='br-int',has_traffic_filtering=True,id=c8c86686-cf6b-46b0-a433-e095f5ce79d7,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8c86686-cf') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d1:64,bridge_name='br-int',has_traffic_filtering=True,id=c8c86686-cf6b-46b0-a433-e095f5ce79d7,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8c86686-cf') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8c86686-cf, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a7c4b15-2601-4a85-a0a0-5723e5f638a8) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-63f85a57-2470-4601-bc41-05916fda216e for instance with vm_state active and task_state deleting.
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-unplugged-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-38bb9e9c-3925-4527-8232-38b330b64587 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-38bb9e9c-3925-4527-8232-38b330b64587 for instance with vm_state active and task_state deleting.
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-unplugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-unplugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-plugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Acquiring lock "a779935e-152e-4223-9a6a-166c9efc490a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] Lock "a779935e-152e-4223-9a6a-166c9efc490a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] No waiting events found dispatching network-vif-plugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING nova.compute.manager [req-ee0318ba-a729-4252-a508-88b9145458fa req-297bd5e4-3289-4375-9c51-b3169a8953a7 service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received unexpected event network-vif-plugged-c8c86686-cf6b-46b0-a433-e095f5ce79d7 for instance with vm_state active and task_state deleting.
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: INFO os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d1:64,bridge_name='br-int',has_traffic_filtering=True,id=c8c86686-cf6b-46b0-a433-e095f5ce79d7,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8c86686-cf')
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2085971327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2085971327',id=11,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkEokC96IVUhtk5yqzCbJidbqeSMcttmJ6AUqqJC/c1jLL1JMc3fnh1tYCir2StLkygJpP4Hv21Zw9dqpI46NPyEE+pHPAbGdkvzvyQpGGt94eVMlkty509SnAdkDPhWg==',key_name='tempest-keypair-1029495729',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4f65d09e9b4024b32a54a536e65e33',ramdisk_id='',reservation_id='r-773btyvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1053262634',owner_user_name='tempest-TaggedBootDevicesTest_v242-1053262634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7eb8edb200f44da9146778c13d49155',uuid=a779935e-152e-4223-9a6a-166c9efc490a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converting VIF {"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:e1,bridge_name='br-int',has_traffic_filtering=True,id=32c78116-87ad-4c2a-82bf-c9a044bbd42c,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c78116-87') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:e1,bridge_name='br-int',has_traffic_filtering=True,id=32c78116-87ad-4c2a-82bf-c9a044bbd42c,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c78116-87') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c78116-87, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=737692d5-da7c-470a-a074-c2f4fc11cdd8) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: INFO os_vif [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:e1,bridge_name='br-int',has_traffic_filtering=True,id=32c78116-87ad-4c2a-82bf-c9a044bbd42c,network=Network(7f04acda-59a0-48f9-b0c3-e537e2b338d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c78116-87')
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AauQjdLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c482db-f312-4dff-a53f-bd197515ffa8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:30:36 user nova-compute[74295]: No targets found.
Oct 26 06:30:36 user nova-compute[74295]: iSNS:
Oct 26 06:30:36 user nova-compute[74295]: No targets found.
Oct 26 06:30:36 user nova-compute[74295]: STATIC:
Oct 26 06:30:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77
Oct 26 06:30:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150
Oct 26 06:30:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b
Oct 26 06:30:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:30:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:36 user nova-compute[74295]: FIRMWARE:
Oct 26 06:30:36 user nova-compute[74295]: No targets found.
Oct 26 06:30:36 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:30:36 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:30:36 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03309fd-4d82-45b9-8e67-7770ec8e0f4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19e3877-8d36-457e-9ad6-13a0c2855f9b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:36 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:30:36 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:36 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:36 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:36 user nova-compute[74295]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 (non-flash)
Oct 26 06:30:36 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:36 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:36 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1be3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef51eb83-56b2-4cde-8097-e865e4d4fbcb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e9ff0b-e261-4ca4-9d33-3d0233b048d3]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef22125a-bc65-4d42-9591-2fc5d6c1c0b9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[48394c90-f939-49c4-a40d-08abe9554917]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fa1e34-89e8-43b8-ae56-8bc7c37d76ff]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b043b5-7cb1-4be9-8815-f3bb88ae4bc6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77, portal: 172.16.0.220,3260]
Oct 26 06:30:36 user nova-compute[74295]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77, portal: 172.16.0.220,3260] successful.
Oct 26 06:30:36 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6698cf-ed5a-4ec4-8139-fa06bb4a4f77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a238f7-e056-4203-8fe2-d7009e46e6f1]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] <== disconnect_volume: return (384ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdSUbeqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:30:36 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:30:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[36df80b1-87de-472e-95d6-5fcc77c1dfb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:30:37 user nova-compute[74295]: No targets found.
Oct 26 06:30:37 user nova-compute[74295]: iSNS:
Oct 26 06:30:37 user nova-compute[74295]: No targets found.
Oct 26 06:30:37 user nova-compute[74295]: STATIC:
Oct 26 06:30:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150
Oct 26 06:30:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b
Oct 26 06:30:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:30:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:37 user nova-compute[74295]: FIRMWARE:
Oct 26 06:30:37 user nova-compute[74295]: No targets found.
Oct 26 06:30:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:30:37 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:30:37 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa885fa7-a6c8-4bdb-9dc3-fe953fdf8e6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b9e80-32ac-4f5b-b103-10c0f3c0b5c2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:37 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:37 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:37 user nova-compute[74295]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b (non-flash)
Oct 26 06:30:37 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac65a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b'): ({'sde'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Removing single pathed devices sde {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Took 0.90 seconds to deallocate network for instance.
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f5937-8837-4b79-83f3-ac5dbd6efdcf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21470a0-197c-4dce-90de-7e5ea0907d59]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Flushing IO for device /dev/sde {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68ad566-c4e8-4938-b6bb-35226d56e7f1]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8c9943-4eb3-4a9b-9022-2fff9d955221]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[673ceec1-3aad-4414-9be6-67cf8af32f8b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6628aaf-ae3b-426c-bd68-e9856aa2f9d3]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b, portal: 172.16.0.220,3260]
Oct 26 06:30:37 user nova-compute[74295]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b, portal: 172.16.0.220,3260] successful.
Oct 26 06:30:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc51339-d786-46e2-b165-25a1d819503b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfca1340-680a-44cd-855c-19d502f54a78]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] <== disconnect_volume: return (360ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoRMiFYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:30:37 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cc7726-1146-43b4-9e0c-887beb9c83de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:30:37 user nova-compute[74295]: No targets found.
Oct 26 06:30:37 user nova-compute[74295]: iSNS:
Oct 26 06:30:37 user nova-compute[74295]: No targets found.
Oct 26 06:30:37 user nova-compute[74295]: STATIC:
Oct 26 06:30:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150
Oct 26 06:30:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:30:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:30:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:30:37 user nova-compute[74295]: FIRMWARE:
Oct 26 06:30:37 user nova-compute[74295]: No targets found.
Oct 26 06:30:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:30:37 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:30:37 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c306337-1ee7-45ed-ab97-2dfb725fd353]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb3384-219b-4710-944c-05d6c7c7e54e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:37 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:30:37 user nova-compute[74295]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 (non-flash)
Oct 26 06:30:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac25c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150'): ({'sdf'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Removing single pathed devices sdf {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a276c0-c591-49dc-8396-995dfd1c1a9d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bade62-fdc2-4014-948f-809643041007]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Flushing IO for device /dev/sdf {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade07a43-ae73-4b8a-b218-3992498ba8d3]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f6ae9d-f9ea-4a7e-bf5a-776b019ace3e]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba68ec1c-2a2f-4477-8c33-da7e895f06b4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f49ce1-b94f-496b-97e5-6706e27317f3]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150, portal: 172.16.0.220,3260]
Oct 26 06:30:37 user nova-compute[74295]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150, portal: 172.16.0.220,3260] successful.
Oct 26 06:30:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e023693d-1ce5-451a-97e7-09c20474a150 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbd00ac-b4ab-4626-beca-8281bf675f28]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] <== disconnect_volume: return (361ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:30:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Deleting instance files /opt/stack/data/nova/instances/a779935e-152e-4223-9a6a-166c9efc490a_del
Oct 26 06:30:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Deletion of /opt/stack/data/nova/instances/a779935e-152e-4223-9a6a-166c9efc490a_del complete
Oct 26 06:30:37 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Deleted allocations for instance 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08
Oct 26 06:30:37 user nova-compute[74295]: INFO nova.compute.manager [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Took 4.17 seconds to destroy the instance on the hypervisor.
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: a779935e-152e-4223-9a6a-166c9efc490a] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:30:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7b226fe4-c57f-4808-8b67-c473a566ef85 tempest-TaggedAttachmentsTest-1270357865 tempest-TaggedAttachmentsTest-1270357865-project-member] Lock "4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.166s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-77498c28-c0a6-4bfd-963c-f527af717033 req-224ad07f-5ead-40e2-914d-3bacd880a90c service nova] [instance: 4577f90e-1c64-4a0f-9cba-e8c8ce5c6c08] Received event network-vif-deleted-ba4ab381-015f-4485-8618-e7c48a5f0d26 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-8e9caed3-1254-49e4-99e4-9b7d4ada537c req-57393e17-76f5-4726-8d2c-121c0ac5be4a service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-deleted-63f85a57-2470-4601-bc41-05916fda216e {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:41 user nova-compute[74295]: INFO nova.compute.manager [req-8e9caed3-1254-49e4-99e4-9b7d4ada537c req-57393e17-76f5-4726-8d2c-121c0ac5be4a service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Neutron deleted interface 63f85a57-2470-4601-bc41-05916fda216e; detaching it from the instance and deleting it from the info cache
Oct 26 06:30:41 user nova-compute[74295]: DEBUG nova.network.neutron [req-8e9caed3-1254-49e4-99e4-9b7d4ada537c req-57393e17-76f5-4726-8d2c-121c0ac5be4a service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [{"id": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "address": "fa:16:3e:4c:72:02", "network": {"id": "01ec9754-956c-4aa5-b9d1-9daa78e8679f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1079307807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41528c15-01", "ovs_interfaceid": "41528c15-0199-45b8-a577-d8c4bd0ecb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "address": "fa:16:3e:99:68:a4", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f63ce6-41", "ovs_interfaceid": "83f63ce6-41bd-4816-b219-ea48b2f8d979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "address": "fa:16:3e:c8:8a:76", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14b7e5-90", "ovs_interfaceid": "eb14b7e5-90b0-416a-b9c1-f59f6bb70c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38bb9e9c-3925-4527-8232-38b330b64587", "address": "fa:16:3e:23:98:34", "network": {"id": "4e3d7600-6161-4f93-81ea-bbcb2b876aa1", "bridge": "br-int", "label": "tempest-device-tagging-net1-179578972", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bb9e9c-39", "ovs_interfaceid": "38bb9e9c-3925-4527-8232-38b330b64587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "address": "fa:16:3e:06:d1:64", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8c86686-cf", "ovs_interfaceid": "c8c86686-cf6b-46b0-a433-e095f5ce79d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "address": "fa:16:3e:9a:04:e1", "network": {"id": "7f04acda-59a0-48f9-b0c3-e537e2b338d9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1798718702", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df4f65d09e9b4024b32a54a536e65e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c78116-87", "ovs_interfaceid": "32c78116-87ad-4c2a-82bf-c9a044bbd42c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-8e9caed3-1254-49e4-99e4-9b7d4ada537c req-57393e17-76f5-4726-8d2c-121c0ac5be4a service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Detach interface failed, port_id=63f85a57-2470-4601-bc41-05916fda216e, reason: Instance a779935e-152e-4223-9a6a-166c9efc490a could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Port f0e3fe7f-b73a-48b6-bc9d-adac272022b4 binding to destination host user is already ACTIVE {{(pid=74295) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquired lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:41 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance_info_cache with network_info: [{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Releasing lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG os_brick.utils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c7aba-bb10-4a39-ac87-0fc512aa1917]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51dd4df-6d50-4afb-8e79-868e12e7fe02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[569309af-72ab-4f0a-91c3-39cef189d785]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8ce206-a73d-45ad-afe1-2ef6459ccee7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:30:42 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:30:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4786afc0-bef4-400f-8ca4-b637e57f46b9]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:30:42 user nova-compute[74295]: DEBUG os_brick.utils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:30:43 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:43 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Took 5.22 seconds to deallocate network for instance.
Oct 26 06:30:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-0c412576-293c-4801-996b-bd1946465530 req-af4eb61e-93a8-48f5-b2a5-07e964a77a8b service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-deleted-c8c86686-cf6b-46b0-a433-e095f5ce79d7 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-0c412576-293c-4801-996b-bd1946465530 req-af4eb61e-93a8-48f5-b2a5-07e964a77a8b service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-deleted-32c78116-87ad-4c2a-82bf-c9a044bbd42c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-0c412576-293c-4801-996b-bd1946465530 req-af4eb61e-93a8-48f5-b2a5-07e964a77a8b service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-deleted-38bb9e9c-3925-4527-8232-38b330b64587 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-0c412576-293c-4801-996b-bd1946465530 req-af4eb61e-93a8-48f5-b2a5-07e964a77a8b service nova] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Received event network-vif-deleted-41528c15-0199-45b8-a577-d8c4bd0ecb82 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:45 user nova-compute[74295]: INFO nova.compute.manager [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] [instance: a779935e-152e-4223-9a6a-166c9efc490a] Took 2.78 seconds to detach 3 volumes for instance.
Oct 26 06:30:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:46 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:30:46 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:30:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:46 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Deleted allocations for instance a779935e-152e-4223-9a6a-166c9efc490a
Oct 26 06:30:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c2357616-f619-4d02-8b92-a3b88825858e tempest-TaggedBootDevicesTest_v242-1053262634 tempest-TaggedBootDevicesTest_v242-1053262634-project-member] Lock "a779935e-152e-4223-9a6a-166c9efc490a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.834s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:56 user nova-compute[74295]: INFO nova.compute.manager [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Rescuing
Oct 26 06:30:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquired lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:30:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:30:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updating instance_info_cache with network_info: [{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Releasing lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-5610e4ba-4794-481a-9152-ef58145e3f2c req-de529184-6bb3-479b-8c76-a396b91a0aaf service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5610e4ba-4794-481a-9152-ef58145e3f2c req-de529184-6bb3-479b-8c76-a396b91a0aaf service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5610e4ba-4794-481a-9152-ef58145e3f2c req-de529184-6bb3-479b-8c76-a396b91a0aaf service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5610e4ba-4794-481a-9152-ef58145e3f2c req-de529184-6bb3-479b-8c76-a396b91a0aaf service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-5610e4ba-4794-481a-9152-ef58145e3f2c req-de529184-6bb3-479b-8c76-a396b91a0aaf service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:57 user nova-compute[74295]: WARNING nova.compute.manager [req-5610e4ba-4794-481a-9152-ef58145e3f2c req-de529184-6bb3-479b-8c76-a396b91a0aaf service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state active and task_state rescuing.
Oct 26 06:30:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Instance destroyed successfully.
Oct 26 06:30:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Attempting rescue
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74295) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Instance directory exists: not creating {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 06:30:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Creating image(s)
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.208s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue" returned: 0 in 0.051s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'migration_context' on Instance uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.base [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<9f9f523a-896e-414d-a24e-ba2c6b6a9834> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Start _get_guest_xml network_info=[{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "vif_mac": "fa:16:3e:5c:16:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'resources' on Instance uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.base [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<9f9f523a-896e-414d-a24e-ba2c6b6a9834> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.base [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<9f9f523a-896e-414d-a24e-ba2c6b6a9834> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:30:57 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:30:57 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.base [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<9f9f523a-896e-414d-a24e-ba2c6b6a9834> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1634403107',display_name='tempest-ServerRescueNegativeTestJSON-server-1634403107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1634403107',id=3,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-rxppw34g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:26:27Z,user_data=None,user_id='3b0e86cf3ec049a58aee69c427717598',uuid=9f9f523a-896e-414d-a24e-ba2c6b6a9834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "vif_mac": "fa:16:3e:5c:16:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "vif_mac": "fa:16:3e:5c:16:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:16:4d,bridge_name='br-int',has_traffic_filtering=True,id=fbea3168-b2c6-4ca2-bad1-949003900aa0,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbea3168-b2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.objects.base [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<9f9f523a-896e-414d-a24e-ba2c6b6a9834> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:30:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:30:57 user nova-compute[74295]:   <uuid>9f9f523a-896e-414d-a24e-ba2c6b6a9834</uuid>
Oct 26 06:30:57 user nova-compute[74295]:   <name>instance-00000003</name>
Oct 26 06:30:57 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:30:57 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:30:57 user nova-compute[74295]:   <metadata>
Oct 26 06:30:57 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:30:57 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:30:57 user nova-compute[74295]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1634403107</nova:name>
Oct 26 06:30:57 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:30:57</nova:creationTime>
Oct 26 06:30:57 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:30:57 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:30:57 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:30:57 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:30:57 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:30:57 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:30:57 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:30:57 user nova-compute[74295]:       <nova:owner>
Oct 26 06:30:57 user nova-compute[74295]:         <nova:user uuid="3b0e86cf3ec049a58aee69c427717598">tempest-ServerRescueNegativeTestJSON-1373728584-project-member</nova:user>
Oct 26 06:30:57 user nova-compute[74295]:         <nova:project uuid="65c33a42f4b946d28de9e355927737e8">tempest-ServerRescueNegativeTestJSON-1373728584</nova:project>
Oct 26 06:30:57 user nova-compute[74295]:       </nova:owner>
Oct 26 06:30:57 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:30:57 user nova-compute[74295]:       <nova:ports>
Oct 26 06:30:57 user nova-compute[74295]:         <nova:port uuid="fbea3168-b2c6-4ca2-bad1-949003900aa0">
Oct 26 06:30:57 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 06:30:57 user nova-compute[74295]:         </nova:port>
Oct 26 06:30:57 user nova-compute[74295]:       </nova:ports>
Oct 26 06:30:57 user nova-compute[74295]:     </nova:instance>
Oct 26 06:30:57 user nova-compute[74295]:   </metadata>
Oct 26 06:30:57 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:30:57 user nova-compute[74295]:     <system>
Oct 26 06:30:57 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:30:57 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:30:57 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:30:57 user nova-compute[74295]:       <entry name="serial">9f9f523a-896e-414d-a24e-ba2c6b6a9834</entry>
Oct 26 06:30:57 user nova-compute[74295]:       <entry name="uuid">9f9f523a-896e-414d-a24e-ba2c6b6a9834</entry>
Oct 26 06:30:57 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:30:57 user nova-compute[74295]:     </system>
Oct 26 06:30:57 user nova-compute[74295]:   </sysinfo>
Oct 26 06:30:57 user nova-compute[74295]:   <os>
Oct 26 06:30:57 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:30:57 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:30:57 user nova-compute[74295]:   </os>
Oct 26 06:30:57 user nova-compute[74295]:   <features>
Oct 26 06:30:57 user nova-compute[74295]:     <acpi/>
Oct 26 06:30:57 user nova-compute[74295]:     <apic/>
Oct 26 06:30:57 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:30:57 user nova-compute[74295]:   </features>
Oct 26 06:30:57 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:30:57 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:30:57 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:30:57 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:30:57 user nova-compute[74295]:   </clock>
Oct 26 06:30:57 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:30:57 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:30:57 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:30:57 user nova-compute[74295]:   </cpu>
Oct 26 06:30:57 user nova-compute[74295]:   <devices>
Oct 26 06:30:57 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:30:57 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:30:57 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue"/>
Oct 26 06:30:57 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:30:57 user nova-compute[74295]:     </disk>
Oct 26 06:30:57 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:30:57 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:30:57 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk"/>
Oct 26 06:30:57 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:30:57 user nova-compute[74295]:     </disk>
Oct 26 06:30:57 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:30:57 user nova-compute[74295]:       <mac address="fa:16:3e:5c:16:4d"/>
Oct 26 06:30:57 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:30:57 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:30:57 user nova-compute[74295]:       <target dev="tapfbea3168-b2"/>
Oct 26 06:30:57 user nova-compute[74295]:     </interface>
Oct 26 06:30:57 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:30:57 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/console.log" append="off"/>
Oct 26 06:30:57 user nova-compute[74295]:     </serial>
Oct 26 06:30:57 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:30:57 user nova-compute[74295]:     <video>
Oct 26 06:30:57 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:30:57 user nova-compute[74295]:     </video>
Oct 26 06:30:57 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:30:57 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:30:57 user nova-compute[74295]:     </rng>
Oct 26 06:30:57 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:30:57 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:30:57 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:30:57 user nova-compute[74295]:     </memballoon>
Oct 26 06:30:57 user nova-compute[74295]:   </devices>
Oct 26 06:30:57 user nova-compute[74295]: </domain>
Oct 26 06:30:57 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:30:58 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Instance destroyed successfully.
Oct 26 06:30:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:30:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:30:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No VIF found with MAC fa:16:3e:5c:16:4d, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:30:58 user nova-compute[74295]: INFO nova.compute.manager [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Rescuing
Oct 26 06:30:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:30:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquired lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:30:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updating instance_info_cache with network_info: [{"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Releasing lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-9542c74f-b5c7-40a5-8782-436364489d8c req-78139d65-e72f-4b2d-9c76-b6c858ca68be service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9542c74f-b5c7-40a5-8782-436364489d8c req-78139d65-e72f-4b2d-9c76-b6c858ca68be service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9542c74f-b5c7-40a5-8782-436364489d8c req-78139d65-e72f-4b2d-9c76-b6c858ca68be service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9542c74f-b5c7-40a5-8782-436364489d8c req-78139d65-e72f-4b2d-9c76-b6c858ca68be service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-9542c74f-b5c7-40a5-8782-436364489d8c req-78139d65-e72f-4b2d-9c76-b6c858ca68be service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:59 user nova-compute[74295]: WARNING nova.compute.manager [req-9542c74f-b5c7-40a5-8782-436364489d8c req-78139d65-e72f-4b2d-9c76-b6c858ca68be service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state active and task_state rescuing.
Oct 26 06:30:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-7c6e4fdc-91bc-4dba-bc67-cc3835d4fc3b req-d7190acf-b580-4428-a68c-ab4b01897e0f service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-unplugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7c6e4fdc-91bc-4dba-bc67-cc3835d4fc3b req-d7190acf-b580-4428-a68c-ab4b01897e0f service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7c6e4fdc-91bc-4dba-bc67-cc3835d4fc3b req-d7190acf-b580-4428-a68c-ab4b01897e0f service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7c6e4fdc-91bc-4dba-bc67-cc3835d4fc3b req-d7190acf-b580-4428-a68c-ab4b01897e0f service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-7c6e4fdc-91bc-4dba-bc67-cc3835d4fc3b req-d7190acf-b580-4428-a68c-ab4b01897e0f service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-unplugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:30:59 user nova-compute[74295]: WARNING nova.compute.manager [req-7c6e4fdc-91bc-4dba-bc67-cc3835d4fc3b req-d7190acf-b580-4428-a68c-ab4b01897e0f service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-unplugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state active and task_state rescuing.
Oct 26 06:30:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:30:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Instance destroyed successfully.
Oct 26 06:31:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Attempting a stable device rescue
Oct 26 06:31:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74295) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 06:31:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Instance directory exists: not creating {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 06:31:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Creating image(s)
Oct 26 06:31:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "/opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "/opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "/opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'trusted_certs' on Instance uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "72576aff223934b109489db4ce70a1c5a0adf0cc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "72576aff223934b109489db4ce70a1c5a0adf0cc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:01 user nova-compute[74295]: WARNING nova.compute.manager [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state active and task_state rescuing.
Oct 26 06:31:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:01 user nova-compute[74295]: WARNING nova.compute.manager [req-9ae3ca64-5c68-4df0-8879-f07dcbc487f4 req-3ff10fdc-cbb6-4b7f-81f8-be00be9654ca service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state active and task_state rescuing.
Oct 26 06:31:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-df104851-20d0-4137-9964-2d96ba45349f req-9a7df6cd-e802-4b51-9c6e-6c731ae97df1 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-df104851-20d0-4137-9964-2d96ba45349f req-9a7df6cd-e802-4b51-9c6e-6c731ae97df1 service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-df104851-20d0-4137-9964-2d96ba45349f req-9a7df6cd-e802-4b51-9c6e-6c731ae97df1 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-df104851-20d0-4137-9964-2d96ba45349f req-9a7df6cd-e802-4b51-9c6e-6c731ae97df1 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-df104851-20d0-4137-9964-2d96ba45349f req-9a7df6cd-e802-4b51-9c6e-6c731ae97df1 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:01 user nova-compute[74295]: WARNING nova.compute.manager [req-df104851-20d0-4137-9964-2d96ba45349f req-9a7df6cd-e802-4b51-9c6e-6c731ae97df1 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state active and task_state rescuing.
Oct 26 06:31:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc.part --force-share --output=json" returned: 0 in 0.236s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG nova.virt.images [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] 4ec57577-5f90-46c4-8e1e-6e7833195596 was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:31:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc.part /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc.part /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc.converted" returned: 0 in 0.520s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc.converted --force-share --output=json" returned: 0 in 0.241s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "72576aff223934b109489db4ce70a1c5a0adf0cc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.055s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "72576aff223934b109489db4ce70a1c5a0adf0cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "72576aff223934b109489db4ce70a1c5a0adf0cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc,backing_fmt=raw /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc,backing_fmt=raw /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue" returned: 0 in 0.066s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "72576aff223934b109489db4ce70a1c5a0adf0cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.objects.instance [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'migration_context' on Instance uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b41cf300-6dd0-415f-b7af-5c235207cce9 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.objects.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<563360ea-d5ca-4006-9c23-3bf9aac300ce> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Start _get_guest_xml network_info=[{"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "vif_mac": "fa:16:3e:c8:c8:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4ec57577-5f90-46c4-8e1e-6e7833195596', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '37f9f37d-7748-4da9-bb1d-52f663f2cb23', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScNZWuHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '563360ea-d5ca-4006-9c23-3bf9aac300ce', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7ce315e-d746-48e0-ae4d-0bdd50f92066', 'serial': 'c7ce315e-d746-48e0-ae4d-0bdd50f92066'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.objects.instance [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'resources' on Instance uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.objects.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<563360ea-d5ca-4006-9c23-3bf9aac300ce> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.objects.instance [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'numa_topology' on Instance uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.objects.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<563360ea-d5ca-4006-9c23-3bf9aac300ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:31:02 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:02 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.objects.instance [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'vcpu_model' on Instance uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:02 user nova-compute[74295]: DEBUG nova.objects.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<563360ea-d5ca-4006-9c23-3bf9aac300ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScNZWuHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:31:03 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:31:03 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:31:03 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfee254-8fd4-4408-873a-33578e3db6f2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ScNZWuHC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 06:31:03 user nova-compute[74295]: node.name = iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:31:03 user nova-compute[74295]: node.tpgt = -1
Oct 26 06:31:03 user nova-compute[74295]: node.startup = automatic
Oct 26 06:31:03 user nova-compute[74295]: node.leading_login = No
Oct 26 06:31:03 user nova-compute[74295]: iface.iscsi_ifacename = default
Oct 26 06:31:03 user nova-compute[74295]: iface.net_ifacename = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.ipaddress = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.prefix_len = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.hwaddress = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.transport_name = tcp
Oct 26 06:31:03 user nova-compute[74295]: iface.initiatorname = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.state = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.vlan_id = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.vlan_priority = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.vlan_state = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.iface_num = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.mtu = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.port = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.bootproto = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.subnet_mask = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.gateway = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.dhcp_alt_client_id = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.dhcp_dns = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.dhcp_learn_iqn = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.dhcp_vendor_id_state = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.dhcp_vendor_id = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.dhcp_slp_da = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.fragmentation = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.gratuitous_arp = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.incoming_forwarding = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.tos_state = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.tos = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.ttl = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.delayed_ack = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.tcp_nagle = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.tcp_wsf_state = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.tcp_wsf = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.tcp_timer_scale = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.tcp_timestamp = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.redirect = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.def_task_mgmt_timeout = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.header_digest = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.data_digest = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.immediate_data = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.initial_r2t = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.data_seq_inorder = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.data_pdu_inorder = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.erl = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.max_receive_data_len = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.first_burst_len = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.max_outstanding_r2t = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.max_burst_len = 0
Oct 26 06:31:03 user nova-compute[74295]: iface.chap_auth = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.bidi_chap = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.strict_login_compliance = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.discovery_auth = <empty>
Oct 26 06:31:03 user nova-compute[74295]: iface.discovery_logout = <empty>
Oct 26 06:31:03 user nova-compute[74295]: node.discovery_address = <empty>
Oct 26 06:31:03 user nova-compute[74295]: node.discovery_port = 0
Oct 26 06:31:03 user nova-compute[74295]: node.discovery_type = static
Oct 26 06:31:03 user nova-compute[74295]: node.session.initial_cmdsn = 0
Oct 26 06:31:03 user nova-compute[74295]: node.session.initial_login_retry_max = 8
Oct 26 06:31:03 user nova-compute[74295]: node.session.xmit_thread_priority = -20
Oct 26 06:31:03 user nova-compute[74295]: node.session.cmds_max = 128
Oct 26 06:31:03 user nova-compute[74295]: node.session.queue_depth = 32
Oct 26 06:31:03 user nova-compute[74295]: node.session.nr_sessions = 1
Oct 26 06:31:03 user nova-compute[74295]: node.session.auth.authmethod = CHAP
Oct 26 06:31:03 user nova-compute[74295]: node.session.auth.username = ScNZWuHC
Oct 26 06:31:03 user nova-compute[74295]: node.session.auth.password = ***
Oct 26 06:31:03 user nova-compute[74295]: node.session.auth.username_in = <empty>
Oct 26 06:31:03 user nova-compute[74295]: node.session.auth.password_in = <empty>
Oct 26 06:31:03 user nova-compute[74295]: node.session.auth.chap_algs = MD5
Oct 26 06:31:03 user nova-compute[74295]: node.session.timeo.replacement_timeout = 120
Oct 26 06:31:03 user nova-compute[74295]: node.session.err_timeo.abort_timeout = 15
Oct 26 06:31:03 user nova-compute[74295]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 06:31:03 user nova-compute[74295]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 06:31:03 user nova-compute[74295]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.FastAbort = Yes
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.InitialR2T = No
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.ImmediateData = Yes
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.MaxConnections = 1
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 06:31:03 user nova-compute[74295]: node.session.iscsi.ERL = 0
Oct 26 06:31:03 user nova-compute[74295]: node.session.scan = manual
Oct 26 06:31:03 user nova-compute[74295]: node.session.reopen_max = 0
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].address = 172.16.0.220
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].port = 3260
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].startup = manual
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].tcp.window_size = 524288
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].tcp.type_of_service = 0
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].timeo.logout_timeout = 15
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].timeo.login_timeout = 15
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].timeo.auth_timeout = 45
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].iscsi.DataDigest = None
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].iscsi.IFMarker = No
Oct 26 06:31:03 user nova-compute[74295]: node.conn[0].iscsi.OFMarker = No
Oct 26 06:31:03 user nova-compute[74295]: # END RECORD
Oct 26 06:31:03 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8450a2-c33a-4da2-8a29-f29c81aedd56]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[47db3c8a-aa1e-471a-84f3-519cfeea4655]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScNZWuHC {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScNZWuHC" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e41782-a618-4878-bc0b-a5555f03ad4c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScNZWuHC'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f632ad7-8833-4cbd-aa22-f099c279a63f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2755c6bd-9b02-405f-8671-c3686e5525f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:31:03 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:31:03 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] HCTL ('33', '0', '0', 0) found on session 10 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e89bc9-0d4d-4f28-9dde-4709b87de5ce]: (4, ('0 0 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching for a device in session 10 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScNZWuHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '23835343461623861', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835343461623861', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1188557978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1188557978',id=12,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:29:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-gak5wurj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:29:46Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=563360ea-d5ca-4006-9c23-3bf9aac300ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "vif_mac": "fa:16:3e:c8:c8:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "vif_mac": "fa:16:3e:c8:c8:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:c8:ae,bridge_name='br-int',has_traffic_filtering=True,id=985646da-fc56-4732-901c-7d0dfd148f33,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985646da-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.objects.instance [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'pci_devices' on Instance uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.objects.base [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<563360ea-d5ca-4006-9c23-3bf9aac300ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:31:03 user nova-compute[74295]:   <uuid>563360ea-d5ca-4006-9c23-3bf9aac300ce</uuid>
Oct 26 06:31:03 user nova-compute[74295]:   <name>instance-0000000c</name>
Oct 26 06:31:03 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:31:03 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:31:03 user nova-compute[74295]:   <metadata>
Oct 26 06:31:03 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:31:03 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:31:03 user nova-compute[74295]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1188557978</nova:name>
Oct 26 06:31:03 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:31:02</nova:creationTime>
Oct 26 06:31:03 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:31:03 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:31:03 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:31:03 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:31:03 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:31:03 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:31:03 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:31:03 user nova-compute[74295]:       <nova:owner>
Oct 26 06:31:03 user nova-compute[74295]:         <nova:user uuid="969b88effa7b4c14a9fdca34760804e8">tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member</nova:user>
Oct 26 06:31:03 user nova-compute[74295]:         <nova:project uuid="e0ac89a741e94482bf18b56aca6a53c1">tempest-ServerBootFromVolumeStableRescueTest-1259261992</nova:project>
Oct 26 06:31:03 user nova-compute[74295]:       </nova:owner>
Oct 26 06:31:03 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:31:03 user nova-compute[74295]:       <nova:ports>
Oct 26 06:31:03 user nova-compute[74295]:         <nova:port uuid="985646da-fc56-4732-901c-7d0dfd148f33">
Oct 26 06:31:03 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 06:31:03 user nova-compute[74295]:         </nova:port>
Oct 26 06:31:03 user nova-compute[74295]:       </nova:ports>
Oct 26 06:31:03 user nova-compute[74295]:     </nova:instance>
Oct 26 06:31:03 user nova-compute[74295]:   </metadata>
Oct 26 06:31:03 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:31:03 user nova-compute[74295]:     <system>
Oct 26 06:31:03 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:31:03 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:31:03 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:31:03 user nova-compute[74295]:       <entry name="serial">563360ea-d5ca-4006-9c23-3bf9aac300ce</entry>
Oct 26 06:31:03 user nova-compute[74295]:       <entry name="uuid">563360ea-d5ca-4006-9c23-3bf9aac300ce</entry>
Oct 26 06:31:03 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:31:03 user nova-compute[74295]:     </system>
Oct 26 06:31:03 user nova-compute[74295]:   </sysinfo>
Oct 26 06:31:03 user nova-compute[74295]:   <os>
Oct 26 06:31:03 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:31:03 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:31:03 user nova-compute[74295]:   </os>
Oct 26 06:31:03 user nova-compute[74295]:   <features>
Oct 26 06:31:03 user nova-compute[74295]:     <acpi/>
Oct 26 06:31:03 user nova-compute[74295]:     <apic/>
Oct 26 06:31:03 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:31:03 user nova-compute[74295]:   </features>
Oct 26 06:31:03 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:31:03 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:31:03 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:31:03 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:31:03 user nova-compute[74295]:   </clock>
Oct 26 06:31:03 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:31:03 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:31:03 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:31:03 user nova-compute[74295]:   </cpu>
Oct 26 06:31:03 user nova-compute[74295]:   <devices>
Oct 26 06:31:03 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:31:03 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:31:03 user nova-compute[74295]:       <source dev="/dev/sdb"/>
Oct 26 06:31:03 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:31:03 user nova-compute[74295]:       <serial>c7ce315e-d746-48e0-ae4d-0bdd50f92066</serial>
Oct 26 06:31:03 user nova-compute[74295]:     </disk>
Oct 26 06:31:03 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:31:03 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:31:03 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue"/>
Oct 26 06:31:03 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:31:03 user nova-compute[74295]:       <boot order="1"/>
Oct 26 06:31:03 user nova-compute[74295]:     </disk>
Oct 26 06:31:03 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:31:03 user nova-compute[74295]:       <mac address="fa:16:3e:c8:c8:ae"/>
Oct 26 06:31:03 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:31:03 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:31:03 user nova-compute[74295]:       <target dev="tap985646da-fc"/>
Oct 26 06:31:03 user nova-compute[74295]:     </interface>
Oct 26 06:31:03 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:31:03 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/console.log" append="off"/>
Oct 26 06:31:03 user nova-compute[74295]:     </serial>
Oct 26 06:31:03 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:31:03 user nova-compute[74295]:     <video>
Oct 26 06:31:03 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:31:03 user nova-compute[74295]:     </video>
Oct 26 06:31:03 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:31:03 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:31:03 user nova-compute[74295]:     </rng>
Oct 26 06:31:03 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:31:03 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:31:03 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:31:03 user nova-compute[74295]:     </memballoon>
Oct 26 06:31:03 user nova-compute[74295]:   </devices>
Oct 26 06:31:03 user nova-compute[74295]: </domain>
Oct 26 06:31:03 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:31:03 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Instance destroyed successfully.
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No VIF found with MAC fa:16:3e:c8:c8:ae, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:31:04 user nova-compute[74295]: INFO nova.compute.claims [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Claim successful on node user
Oct 26 06:31:04 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:31:04 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2b3fefd6-c398-4f4a-8a95-d83dcd80baf1 req-9c749938-662b-44ac-a8b3-5c8a7cae4b11 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2b3fefd6-c398-4f4a-8a95-d83dcd80baf1 req-9c749938-662b-44ac-a8b3-5c8a7cae4b11 service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2b3fefd6-c398-4f4a-8a95-d83dcd80baf1 req-9c749938-662b-44ac-a8b3-5c8a7cae4b11 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2b3fefd6-c398-4f4a-8a95-d83dcd80baf1 req-9c749938-662b-44ac-a8b3-5c8a7cae4b11 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2b3fefd6-c398-4f4a-8a95-d83dcd80baf1 req-9c749938-662b-44ac-a8b3-5c8a7cae4b11 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:05 user nova-compute[74295]: WARNING nova.compute.manager [req-2b3fefd6-c398-4f4a-8a95-d83dcd80baf1 req-9c749938-662b-44ac-a8b3-5c8a7cae4b11 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state active and task_state rescuing.
Oct 26 06:31:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.776s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updating instance_info_cache with network_info: [{"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:31:05 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.policy [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c04fd24cda04bb68280748d9588d289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f09cde7274f9d84c09303f90b7e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:31:05 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Creating image(s)
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "/opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "/opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.204s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk 1073741824" returned: 0 in 0.061s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Successfully created port: 3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.250s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Cannot resize image /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Ensure instance console log exists: /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Successfully updated port: 3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-60deb5ae-954f-40e1-89e3-0da82ba65477 req-f692def3-ff97-479d-82a2-ef06deaac7ff service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received event network-changed-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-60deb5ae-954f-40e1-89e3-0da82ba65477 req-f692def3-ff97-479d-82a2-ef06deaac7ff service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Refreshing instance network info cache due to event network-changed-3a25550b-3555-4da8-81b1-8510844fc8ec. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-60deb5ae-954f-40e1-89e3-0da82ba65477 req-f692def3-ff97-479d-82a2-ef06deaac7ff service nova] Acquiring lock "refresh_cache-b1f13ee5-22e7-466c-a117-ae4a707ad2bc" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-60deb5ae-954f-40e1-89e3-0da82ba65477 req-f692def3-ff97-479d-82a2-ef06deaac7ff service nova] Acquired lock "refresh_cache-b1f13ee5-22e7-466c-a117-ae4a707ad2bc" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG nova.network.neutron [req-60deb5ae-954f-40e1-89e3-0da82ba65477 req-f692def3-ff97-479d-82a2-ef06deaac7ff service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Refreshing network info cache for port 3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "refresh_cache-b1f13ee5-22e7-466c-a117-ae4a707ad2bc" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-60deb5ae-954f-40e1-89e3-0da82ba65477 req-f692def3-ff97-479d-82a2-ef06deaac7ff service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-3ad3354f-19fb-4e89-8059-e162e4e26857 req-a5dddbe3-af63-44ff-88d1-e37d0f6df4a5 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3ad3354f-19fb-4e89-8059-e162e4e26857 req-a5dddbe3-af63-44ff-88d1-e37d0f6df4a5 service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3ad3354f-19fb-4e89-8059-e162e4e26857 req-a5dddbe3-af63-44ff-88d1-e37d0f6df4a5 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3ad3354f-19fb-4e89-8059-e162e4e26857 req-a5dddbe3-af63-44ff-88d1-e37d0f6df4a5 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-3ad3354f-19fb-4e89-8059-e162e4e26857 req-a5dddbe3-af63-44ff-88d1-e37d0f6df4a5 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:07 user nova-compute[74295]: WARNING nova.compute.manager [req-3ad3354f-19fb-4e89-8059-e162e4e26857 req-a5dddbe3-af63-44ff-88d1-e37d0f6df4a5 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state active and task_state rescuing.
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-02c7600a-8306-4f6c-99e8-136096f1015a tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-60deb5ae-954f-40e1-89e3-0da82ba65477 req-f692def3-ff97-479d-82a2-ef06deaac7ff service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-60deb5ae-954f-40e1-89e3-0da82ba65477 req-f692def3-ff97-479d-82a2-ef06deaac7ff service nova] Releasing lock "refresh_cache-b1f13ee5-22e7-466c-a117-ae4a707ad2bc" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquired lock "refresh_cache-b1f13ee5-22e7-466c-a117-ae4a707ad2bc" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG nova.network.neutron [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG nova.network.neutron [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Updating instance_info_cache with network_info: [{"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Releasing lock "refresh_cache-b1f13ee5-22e7-466c-a117-ae4a707ad2bc" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Instance network_info: |[{"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Start _get_guest_xml network_info=[{"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:31:08 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:08 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-166092043',display_name='tempest-TestVolumeSwap-server-166092043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-166092043',id=16,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQWaT81crNUyJOINzc4X8Jp9xQ/W8we72QGFBnb+X6LK91FfOWnu6kpdGA4JQeCMEwXz5pi+0KJUwjTe6icVA6gQiVuAaKaACr9RjtY3gwfHWZQr/SETLFTfpmbLE8+ow==',key_name='tempest-keypair-701294580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a6f09cde7274f9d84c09303f90b7e57',ramdisk_id='',reservation_id='r-8piwvzgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2032701720',owner_user_name='tempest-TestVolumeSwap-2032701720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c04fd24cda04bb68280748d9588d289',uuid=b1f13ee5-22e7-466c-a117-ae4a707ad2bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Converting VIF {"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:94,bridge_name='br-int',has_traffic_filtering=True,id=3a25550b-3555-4da8-81b1-8510844fc8ec,network=Network(de5a46e9-64a7-47b5-8d16-d1e81d21db18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a25550b-35') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.objects.instance [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lazy-loading 'pci_devices' on Instance uuid b1f13ee5-22e7-466c-a117-ae4a707ad2bc {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:31:08 user nova-compute[74295]:   <uuid>b1f13ee5-22e7-466c-a117-ae4a707ad2bc</uuid>
Oct 26 06:31:08 user nova-compute[74295]:   <name>instance-00000010</name>
Oct 26 06:31:08 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:31:08 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:31:08 user nova-compute[74295]:   <metadata>
Oct 26 06:31:08 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:31:08 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:31:08 user nova-compute[74295]:       <nova:name>tempest-TestVolumeSwap-server-166092043</nova:name>
Oct 26 06:31:08 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:31:08</nova:creationTime>
Oct 26 06:31:08 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:31:08 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:31:08 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:31:08 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:31:08 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:31:08 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:31:08 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:31:08 user nova-compute[74295]:       <nova:owner>
Oct 26 06:31:08 user nova-compute[74295]:         <nova:user uuid="8c04fd24cda04bb68280748d9588d289">tempest-TestVolumeSwap-2032701720-project-member</nova:user>
Oct 26 06:31:08 user nova-compute[74295]:         <nova:project uuid="9a6f09cde7274f9d84c09303f90b7e57">tempest-TestVolumeSwap-2032701720</nova:project>
Oct 26 06:31:08 user nova-compute[74295]:       </nova:owner>
Oct 26 06:31:08 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:31:08 user nova-compute[74295]:       <nova:ports>
Oct 26 06:31:08 user nova-compute[74295]:         <nova:port uuid="3a25550b-3555-4da8-81b1-8510844fc8ec">
Oct 26 06:31:08 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 06:31:08 user nova-compute[74295]:         </nova:port>
Oct 26 06:31:08 user nova-compute[74295]:       </nova:ports>
Oct 26 06:31:08 user nova-compute[74295]:     </nova:instance>
Oct 26 06:31:08 user nova-compute[74295]:   </metadata>
Oct 26 06:31:08 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:31:08 user nova-compute[74295]:     <system>
Oct 26 06:31:08 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:31:08 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:31:08 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:31:08 user nova-compute[74295]:       <entry name="serial">b1f13ee5-22e7-466c-a117-ae4a707ad2bc</entry>
Oct 26 06:31:08 user nova-compute[74295]:       <entry name="uuid">b1f13ee5-22e7-466c-a117-ae4a707ad2bc</entry>
Oct 26 06:31:08 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:31:08 user nova-compute[74295]:     </system>
Oct 26 06:31:08 user nova-compute[74295]:   </sysinfo>
Oct 26 06:31:08 user nova-compute[74295]:   <os>
Oct 26 06:31:08 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:31:08 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:31:08 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:31:08 user nova-compute[74295]:   </os>
Oct 26 06:31:08 user nova-compute[74295]:   <features>
Oct 26 06:31:08 user nova-compute[74295]:     <acpi/>
Oct 26 06:31:08 user nova-compute[74295]:     <apic/>
Oct 26 06:31:08 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:31:08 user nova-compute[74295]:   </features>
Oct 26 06:31:08 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:31:08 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:31:08 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:31:08 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:31:08 user nova-compute[74295]:   </clock>
Oct 26 06:31:08 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:31:08 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:31:08 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:31:08 user nova-compute[74295]:   </cpu>
Oct 26 06:31:08 user nova-compute[74295]:   <devices>
Oct 26 06:31:08 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:31:08 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:31:08 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk"/>
Oct 26 06:31:08 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:31:08 user nova-compute[74295]:     </disk>
Oct 26 06:31:08 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:31:08 user nova-compute[74295]:       <mac address="fa:16:3e:82:35:94"/>
Oct 26 06:31:08 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:31:08 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:31:08 user nova-compute[74295]:       <target dev="tap3a25550b-35"/>
Oct 26 06:31:08 user nova-compute[74295]:     </interface>
Oct 26 06:31:08 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:31:08 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/console.log" append="off"/>
Oct 26 06:31:08 user nova-compute[74295]:     </serial>
Oct 26 06:31:08 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:31:08 user nova-compute[74295]:     <video>
Oct 26 06:31:08 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:31:08 user nova-compute[74295]:     </video>
Oct 26 06:31:08 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:31:08 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:31:08 user nova-compute[74295]:     </rng>
Oct 26 06:31:08 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:31:08 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:31:08 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:31:08 user nova-compute[74295]:     </memballoon>
Oct 26 06:31:08 user nova-compute[74295]:   </devices>
Oct 26 06:31:08 user nova-compute[74295]: </domain>
Oct 26 06:31:08 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-166092043',display_name='tempest-TestVolumeSwap-server-166092043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-166092043',id=16,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQWaT81crNUyJOINzc4X8Jp9xQ/W8we72QGFBnb+X6LK91FfOWnu6kpdGA4JQeCMEwXz5pi+0KJUwjTe6icVA6gQiVuAaKaACr9RjtY3gwfHWZQr/SETLFTfpmbLE8+ow==',key_name='tempest-keypair-701294580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a6f09cde7274f9d84c09303f90b7e57',ramdisk_id='',reservation_id='r-8piwvzgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2032701720',owner_user_name='tempest-TestVolumeSwap-2032701720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c04fd24cda04bb68280748d9588d289',uuid=b1f13ee5-22e7-466c-a117-ae4a707ad2bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Converting VIF {"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:94,bridge_name='br-int',has_traffic_filtering=True,id=3a25550b-3555-4da8-81b1-8510844fc8ec,network=Network(de5a46e9-64a7-47b5-8d16-d1e81d21db18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a25550b-35') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG os_vif [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:94,bridge_name='br-int',has_traffic_filtering=True,id=3a25550b-3555-4da8-81b1-8510844fc8ec,network=Network(de5a46e9-64a7-47b5-8d16-d1e81d21db18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a25550b-35') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b9af8f3-2cc2-5178-9d77-dc68a815f2b4', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a25550b-35, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a25550b-35, col_values=(('qos', UUID('79e1c781-a273-47c2-acc6-565f3782764a')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a25550b-35, col_values=(('external_ids', {'iface-id': '3a25550b-3555-4da8-81b1-8510844fc8ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:35:94', 'vm-uuid': 'b1f13ee5-22e7-466c-a117-ae4a707ad2bc'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:08 user nova-compute[74295]: INFO os_vif [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:94,bridge_name='br-int',has_traffic_filtering=True,id=3a25550b-3555-4da8-81b1-8510844fc8ec,network=Network(de5a46e9-64a7-47b5-8d16-d1e81d21db18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a25550b-35')
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] No VIF found with MAC fa:16:3e:82:35:94, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG nova.compute.manager [req-75907e49-e986-4c58-b6d7-5f68955ece4c req-c237ef57-bf6c-42ac-a607-33b3ef63b2eb service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received event network-vif-plugged-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-75907e49-e986-4c58-b6d7-5f68955ece4c req-c237ef57-bf6c-42ac-a607-33b3ef63b2eb service nova] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-75907e49-e986-4c58-b6d7-5f68955ece4c req-c237ef57-bf6c-42ac-a607-33b3ef63b2eb service nova] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-75907e49-e986-4c58-b6d7-5f68955ece4c req-c237ef57-bf6c-42ac-a607-33b3ef63b2eb service nova] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG nova.compute.manager [req-75907e49-e986-4c58-b6d7-5f68955ece4c req-c237ef57-bf6c-42ac-a607-33b3ef63b2eb service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] No waiting events found dispatching network-vif-plugged-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:10 user nova-compute[74295]: WARNING nova.compute.manager [req-75907e49-e986-4c58-b6d7-5f68955ece4c req-c237ef57-bf6c-42ac-a607-33b3ef63b2eb service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received unexpected event network-vif-plugged-3a25550b-3555-4da8-81b1-8510844fc8ec for instance with vm_state building and task_state spawning.
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-136f1d27-953e-4a6f-89af-87f46f653820 req-c9837c0b-ebc4-4541-9e7b-ed4eda40ac01 service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received event network-vif-plugged-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-136f1d27-953e-4a6f-89af-87f46f653820 req-c9837c0b-ebc4-4541-9e7b-ed4eda40ac01 service nova] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-136f1d27-953e-4a6f-89af-87f46f653820 req-c9837c0b-ebc4-4541-9e7b-ed4eda40ac01 service nova] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-136f1d27-953e-4a6f-89af-87f46f653820 req-c9837c0b-ebc4-4541-9e7b-ed4eda40ac01 service nova] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-136f1d27-953e-4a6f-89af-87f46f653820 req-c9837c0b-ebc4-4541-9e7b-ed4eda40ac01 service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] No waiting events found dispatching network-vif-plugged-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:12 user nova-compute[74295]: WARNING nova.compute.manager [req-136f1d27-953e-4a6f-89af-87f46f653820 req-c9837c0b-ebc4-4541-9e7b-ed4eda40ac01 service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received unexpected event network-vif-plugged-3a25550b-3555-4da8-81b1-8510844fc8ec for instance with vm_state building and task_state spawning.
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:31:12 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:12 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7622MB free_disk=25.350261688232422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:12 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Instance spawned successfully.
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:13 user nova-compute[74295]: INFO nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Took 7.54 seconds to spawn the instance on the hypervisor.
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Applying migration context for instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 as it has an incoming, in-progress migration 288bbde7-fba4-4018-867d-86cae276705e. Migration status is post-migrating {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 06:31:13 user nova-compute[74295]: INFO nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating resource usage from migration 288bbde7-fba4-4018-867d-86cae276705e
Oct 26 06:31:13 user nova-compute[74295]: INFO nova.compute.manager [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Took 8.82 seconds to build instance.
Oct 26 06:31:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-06106358-49c1-4bb7-8706-6de389ec0273 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.939s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 88335730-9d04-4614-8c24-f0c3957418f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 48f22cde-4b90-43de-aba1-968afce2ddce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cf010631-119f-42b0-a356-a645b27e4081 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1229385f-194e-482e-ac54-ca9cc2591edd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Migration 288bbde7-fba4-4018-867d-86cae276705e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1f13ee5-22e7-466c-a117-ae4a707ad2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:31:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.738s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Starting finish_migration {{(pid=74295) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 06:31:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance directory exists: not creating {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 06:31:19 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Creating image(s)
Oct 26 06:31:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.247s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:19 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk. size=21474836480 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:31:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk 21474836480 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk 21474836480" returned: 0 in 0.065s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Ensure instance console log exists: /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Start _get_guest_xml network_info=[{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971519128-network", "vif_mac": "fa:16:3e:ad:4f:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '4b0531de-49ac-4e11-8e38-b19a5641a01a', 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '775d5e2e-95a6-4a86-b6f3-ce96735378d9', 'attached_at': '2023-10-26T06:31:19.000000', 'detached_at': '', 'volume_id': '0f212bc3-b89c-4588-9186-df7b86c44e6b', 'serial': '0f212bc3-b89c-4588-9186-df7b86c44e6b'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:31:20 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:20 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:31:20 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:31:20 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:31:20 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74ac8ac-2b3d-4cc3-a68d-931271aca04b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:31:20 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[72deb5f9-cfe8-44fb-afa9-e2d4a8b1669f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b] added
Oct 26 06:31:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48cd52e-f0e7-4bcc-a4c5-f3ac7cd13e49]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9d2fb0-6d97-4855-9965-315c3824b358]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFgsenmy {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFgsenmy" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[869f7575-2c39-47b3-9647-a831802d39f1]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RFgsenmy'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c025fb02-2186-4504-8ba4-0a1585e19f87]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7691ddbd-6a63-4254-934f-f01a5a7f4aa4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:31:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:31:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e1a1f5-5b68-4e83-a771-2e3dcd7be1b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]
Oct 26 06:31:20 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.
Oct 26 06:31:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a23361e-3721-4e39-a6f5-b453b2e08ed9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[728692c1-067c-45b7-a5de-e5e0201436ba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:31:20 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:31:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:31:20 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:31:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aabfc07-9428-41ad-83d0-1ca51184d4d5]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:31:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23661646561646436', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661646561646436', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-97936637',display_name='tempest-ServerActionsTestOtherB-server-97936637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-97936637',id=4,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmm1IaoBoVd8Hkv3gtx/L78lFPzYOW0A2Qqc9FfseOv4MiM64O4tVX1rCM39AF+LH46KHkGVTicvdWviQLc+ppyTXiLGRvBGUpaFnTBwUaROd5zinEiEdd3gXRLbgwTBg==',key_name='tempest-keypair-393220372',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd8a2b9f8cce49d4985549fd42dc1e8a',ramdisk_id='',reservation_id='r-cmxn1myp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-406693711',owner_user_name='tempest-ServerActionsTestOtherB-406693711-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e44a6886b2b478dbca031edd15a9a6f',uuid=775d5e2e-95a6-4a86-b6f3-ce96735378d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971519128-network", "vif_mac": "fa:16:3e:ad:4f:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converting VIF {"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971519128-network", "vif_mac": "fa:16:3e:ad:4f:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:31:21 user nova-compute[74295]:   <uuid>775d5e2e-95a6-4a86-b6f3-ce96735378d9</uuid>
Oct 26 06:31:21 user nova-compute[74295]:   <name>instance-00000004</name>
Oct 26 06:31:21 user nova-compute[74295]:   <memory>2097152</memory>
Oct 26 06:31:21 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:31:21 user nova-compute[74295]:   <metadata>
Oct 26 06:31:21 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:31:21 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:31:21 user nova-compute[74295]:       <nova:name>tempest-ServerActionsTestOtherB-server-97936637</nova:name>
Oct 26 06:31:21 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:31:20</nova:creationTime>
Oct 26 06:31:21 user nova-compute[74295]:       <nova:flavor name="m1.small">
Oct 26 06:31:21 user nova-compute[74295]:         <nova:memory>2048</nova:memory>
Oct 26 06:31:21 user nova-compute[74295]:         <nova:disk>20</nova:disk>
Oct 26 06:31:21 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:31:21 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:31:21 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:31:21 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:31:21 user nova-compute[74295]:       <nova:owner>
Oct 26 06:31:21 user nova-compute[74295]:         <nova:user uuid="8e44a6886b2b478dbca031edd15a9a6f">tempest-ServerActionsTestOtherB-406693711-project-member</nova:user>
Oct 26 06:31:21 user nova-compute[74295]:         <nova:project uuid="dd8a2b9f8cce49d4985549fd42dc1e8a">tempest-ServerActionsTestOtherB-406693711</nova:project>
Oct 26 06:31:21 user nova-compute[74295]:       </nova:owner>
Oct 26 06:31:21 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:31:21 user nova-compute[74295]:       <nova:ports>
Oct 26 06:31:21 user nova-compute[74295]:         <nova:port uuid="f0e3fe7f-b73a-48b6-bc9d-adac272022b4">
Oct 26 06:31:21 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 06:31:21 user nova-compute[74295]:         </nova:port>
Oct 26 06:31:21 user nova-compute[74295]:       </nova:ports>
Oct 26 06:31:21 user nova-compute[74295]:     </nova:instance>
Oct 26 06:31:21 user nova-compute[74295]:   </metadata>
Oct 26 06:31:21 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:31:21 user nova-compute[74295]:     <system>
Oct 26 06:31:21 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:31:21 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:31:21 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:31:21 user nova-compute[74295]:       <entry name="serial">775d5e2e-95a6-4a86-b6f3-ce96735378d9</entry>
Oct 26 06:31:21 user nova-compute[74295]:       <entry name="uuid">775d5e2e-95a6-4a86-b6f3-ce96735378d9</entry>
Oct 26 06:31:21 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:31:21 user nova-compute[74295]:     </system>
Oct 26 06:31:21 user nova-compute[74295]:   </sysinfo>
Oct 26 06:31:21 user nova-compute[74295]:   <os>
Oct 26 06:31:21 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:31:21 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:31:21 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:31:21 user nova-compute[74295]:   </os>
Oct 26 06:31:21 user nova-compute[74295]:   <features>
Oct 26 06:31:21 user nova-compute[74295]:     <acpi/>
Oct 26 06:31:21 user nova-compute[74295]:     <apic/>
Oct 26 06:31:21 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:31:21 user nova-compute[74295]:   </features>
Oct 26 06:31:21 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:31:21 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:31:21 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:31:21 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:31:21 user nova-compute[74295]:   </clock>
Oct 26 06:31:21 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:31:21 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:31:21 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:31:21 user nova-compute[74295]:   </cpu>
Oct 26 06:31:21 user nova-compute[74295]:   <devices>
Oct 26 06:31:21 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:31:21 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:31:21 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk"/>
Oct 26 06:31:21 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:31:21 user nova-compute[74295]:     </disk>
Oct 26 06:31:21 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:31:21 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:31:21 user nova-compute[74295]:       <source dev="/dev/sdc"/>
Oct 26 06:31:21 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:31:21 user nova-compute[74295]:       <serial>0f212bc3-b89c-4588-9186-df7b86c44e6b</serial>
Oct 26 06:31:21 user nova-compute[74295]:     </disk>
Oct 26 06:31:21 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:31:21 user nova-compute[74295]:       <mac address="fa:16:3e:ad:4f:d9"/>
Oct 26 06:31:21 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:31:21 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:31:21 user nova-compute[74295]:       <target dev="tapf0e3fe7f-b7"/>
Oct 26 06:31:21 user nova-compute[74295]:     </interface>
Oct 26 06:31:21 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:31:21 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/console.log" append="off"/>
Oct 26 06:31:21 user nova-compute[74295]:     </serial>
Oct 26 06:31:21 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:31:21 user nova-compute[74295]:     <video>
Oct 26 06:31:21 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:31:21 user nova-compute[74295]:     </video>
Oct 26 06:31:21 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:31:21 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:31:21 user nova-compute[74295]:     </rng>
Oct 26 06:31:21 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:31:21 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:31:21 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:31:21 user nova-compute[74295]:     </memballoon>
Oct 26 06:31:21 user nova-compute[74295]:   </devices>
Oct 26 06:31:21 user nova-compute[74295]: </domain>
Oct 26 06:31:21 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-97936637',display_name='tempest-ServerActionsTestOtherB-server-97936637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-97936637',id=4,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmm1IaoBoVd8Hkv3gtx/L78lFPzYOW0A2Qqc9FfseOv4MiM64O4tVX1rCM39AF+LH46KHkGVTicvdWviQLc+ppyTXiLGRvBGUpaFnTBwUaROd5zinEiEdd3gXRLbgwTBg==',key_name='tempest-keypair-393220372',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd8a2b9f8cce49d4985549fd42dc1e8a',ramdisk_id='',reservation_id='r-cmxn1myp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-406693711',owner_user_name='tempest-ServerActionsTestOtherB-406693711-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e44a6886b2b478dbca031edd15a9a6f',uuid=775d5e2e-95a6-4a86-b6f3-ce96735378d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971519128-network", "vif_mac": "fa:16:3e:ad:4f:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converting VIF {"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971519128-network", "vif_mac": "fa:16:3e:ad:4f:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG os_vif [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09c8a9b3-4d0d-53c7-b32d-edd04837daa9', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0e3fe7f-b7, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0e3fe7f-b7, col_values=(('qos', UUID('85e7bb0d-cbef-4800-b004-43669d2b98c4')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0e3fe7f-b7, col_values=(('external_ids', {'iface-id': 'f0e3fe7f-b73a-48b6-bc9d-adac272022b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:4f:d9', 'vm-uuid': '775d5e2e-95a6-4a86-b6f3-ce96735378d9'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:21 user nova-compute[74295]: INFO os_vif [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7')
Oct 26 06:31:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:31:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] No VIF found with MAC fa:16:3e:ad:4f:d9, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG nova.compute.manager [req-a5c68181-0f0c-428d-9134-eed7e24b6fbf req-f93b589e-199a-4bcd-9c08-cfc68f107613 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a5c68181-0f0c-428d-9134-eed7e24b6fbf req-f93b589e-199a-4bcd-9c08-cfc68f107613 service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a5c68181-0f0c-428d-9134-eed7e24b6fbf req-f93b589e-199a-4bcd-9c08-cfc68f107613 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a5c68181-0f0c-428d-9134-eed7e24b6fbf req-f93b589e-199a-4bcd-9c08-cfc68f107613 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG nova.compute.manager [req-a5c68181-0f0c-428d-9134-eed7e24b6fbf req-f93b589e-199a-4bcd-9c08-cfc68f107613 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:23 user nova-compute[74295]: WARNING nova.compute.manager [req-a5c68181-0f0c-428d-9134-eed7e24b6fbf req-f93b589e-199a-4bcd-9c08-cfc68f107613 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state active and task_state resize_finish.
Oct 26 06:31:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:31:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance running successfully.
Oct 26 06:31:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Failed to set time: agent not configured {{(pid=74295) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 06:31:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c9dd5812-1adc-41ae-9009-6ab5307d441b tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] finish_migration finished successfully. {{(pid=74295) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 06:31:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-2da64481-77fc-425f-b7fd-1934cceffe02 req-8db9d64a-4c7a-43aa-a819-bebeeed18135 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2da64481-77fc-425f-b7fd-1934cceffe02 req-8db9d64a-4c7a-43aa-a819-bebeeed18135 service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2da64481-77fc-425f-b7fd-1934cceffe02 req-8db9d64a-4c7a-43aa-a819-bebeeed18135 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2da64481-77fc-425f-b7fd-1934cceffe02 req-8db9d64a-4c7a-43aa-a819-bebeeed18135 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-2da64481-77fc-425f-b7fd-1934cceffe02 req-8db9d64a-4c7a-43aa-a819-bebeeed18135 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:25 user nova-compute[74295]: WARNING nova.compute.manager [req-2da64481-77fc-425f-b7fd-1934cceffe02 req-8db9d64a-4c7a-43aa-a819-bebeeed18135 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state active and task_state resize_finish.
Oct 26 06:31:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "0440536c-c9ad-439e-aa26-689b945c63ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "0440536c-c9ad-439e-aa26-689b945c63ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:30 user nova-compute[74295]: DEBUG nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:31:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:30 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:31:30 user nova-compute[74295]: INFO nova.compute.claims [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Claim successful on node user
Oct 26 06:31:31 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG nova.network.neutron [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:31:31 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:31:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG nova.policy [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91925e095e034d3cb49445f191f910b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beceb88c1357495f9a2a600dc7bbfa1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:31:31 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Creating image(s)
Oct 26 06:31:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "/opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "/opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "/opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.059s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.257s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.249s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG nova.network.neutron [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Successfully created port: 91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk 1073741824" returned: 0 in 0.060s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.255s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Cannot resize image /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Ensure instance console log exists: /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Successfully updated port: 91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "refresh_cache-0440536c-c9ad-439e-aa26-689b945c63ea" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquired lock "refresh_cache-0440536c-c9ad-439e-aa26-689b945c63ea" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-99c17874-2f97-4392-bdca-4dc93e4b5d30 req-4626b0f8-02a8-4a32-82d9-1da5b03b1247 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received event network-changed-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-99c17874-2f97-4392-bdca-4dc93e4b5d30 req-4626b0f8-02a8-4a32-82d9-1da5b03b1247 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Refreshing instance network info cache due to event network-changed-91fed54a-b08d-47ca-a309-e7d098954c85. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-99c17874-2f97-4392-bdca-4dc93e4b5d30 req-4626b0f8-02a8-4a32-82d9-1da5b03b1247 service nova] Acquiring lock "refresh_cache-0440536c-c9ad-439e-aa26-689b945c63ea" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Updating instance_info_cache with network_info: [{"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Releasing lock "refresh_cache-0440536c-c9ad-439e-aa26-689b945c63ea" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Instance network_info: |[{"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-99c17874-2f97-4392-bdca-4dc93e4b5d30 req-4626b0f8-02a8-4a32-82d9-1da5b03b1247 service nova] Acquired lock "refresh_cache-0440536c-c9ad-439e-aa26-689b945c63ea" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.neutron [req-99c17874-2f97-4392-bdca-4dc93e4b5d30 req-4626b0f8-02a8-4a32-82d9-1da5b03b1247 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Refreshing network info cache for port 91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Start _get_guest_xml network_info=[{"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:31:33 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:33 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-746197758',display_name='tempest-ServersNegativeTestJSON-server-746197758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-746197758',id=17,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beceb88c1357495f9a2a600dc7bbfa1f',ramdisk_id='',reservation_id='r-hdr4kelk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-274276408',owner_user_name='tempest-ServersNegativeTestJSON-274276408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:31:32Z,user_data=None,user_id='91925e095e034d3cb49445f191f910b1',uuid=0440536c-c9ad-439e-aa26-689b945c63ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converting VIF {"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=91fed54a-b08d-47ca-a309-e7d098954c85,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91fed54a-b0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.objects.instance [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lazy-loading 'pci_devices' on Instance uuid 0440536c-c9ad-439e-aa26-689b945c63ea {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:31:33 user nova-compute[74295]:   <uuid>0440536c-c9ad-439e-aa26-689b945c63ea</uuid>
Oct 26 06:31:33 user nova-compute[74295]:   <name>instance-00000011</name>
Oct 26 06:31:33 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:31:33 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:31:33 user nova-compute[74295]:   <metadata>
Oct 26 06:31:33 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:31:33 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:31:33 user nova-compute[74295]:       <nova:name>tempest-ServersNegativeTestJSON-server-746197758</nova:name>
Oct 26 06:31:33 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:31:33</nova:creationTime>
Oct 26 06:31:33 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:31:33 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:31:33 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:31:33 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:31:33 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:31:33 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:31:33 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:31:33 user nova-compute[74295]:       <nova:owner>
Oct 26 06:31:33 user nova-compute[74295]:         <nova:user uuid="91925e095e034d3cb49445f191f910b1">tempest-ServersNegativeTestJSON-274276408-project-member</nova:user>
Oct 26 06:31:33 user nova-compute[74295]:         <nova:project uuid="beceb88c1357495f9a2a600dc7bbfa1f">tempest-ServersNegativeTestJSON-274276408</nova:project>
Oct 26 06:31:33 user nova-compute[74295]:       </nova:owner>
Oct 26 06:31:33 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:31:33 user nova-compute[74295]:       <nova:ports>
Oct 26 06:31:33 user nova-compute[74295]:         <nova:port uuid="91fed54a-b08d-47ca-a309-e7d098954c85">
Oct 26 06:31:33 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 06:31:33 user nova-compute[74295]:         </nova:port>
Oct 26 06:31:33 user nova-compute[74295]:       </nova:ports>
Oct 26 06:31:33 user nova-compute[74295]:     </nova:instance>
Oct 26 06:31:33 user nova-compute[74295]:   </metadata>
Oct 26 06:31:33 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:31:33 user nova-compute[74295]:     <system>
Oct 26 06:31:33 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:31:33 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:31:33 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:31:33 user nova-compute[74295]:       <entry name="serial">0440536c-c9ad-439e-aa26-689b945c63ea</entry>
Oct 26 06:31:33 user nova-compute[74295]:       <entry name="uuid">0440536c-c9ad-439e-aa26-689b945c63ea</entry>
Oct 26 06:31:33 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:31:33 user nova-compute[74295]:     </system>
Oct 26 06:31:33 user nova-compute[74295]:   </sysinfo>
Oct 26 06:31:33 user nova-compute[74295]:   <os>
Oct 26 06:31:33 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:31:33 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:31:33 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:31:33 user nova-compute[74295]:   </os>
Oct 26 06:31:33 user nova-compute[74295]:   <features>
Oct 26 06:31:33 user nova-compute[74295]:     <acpi/>
Oct 26 06:31:33 user nova-compute[74295]:     <apic/>
Oct 26 06:31:33 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:31:33 user nova-compute[74295]:   </features>
Oct 26 06:31:33 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:31:33 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:31:33 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:31:33 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:31:33 user nova-compute[74295]:   </clock>
Oct 26 06:31:33 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:31:33 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:31:33 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:31:33 user nova-compute[74295]:   </cpu>
Oct 26 06:31:33 user nova-compute[74295]:   <devices>
Oct 26 06:31:33 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:31:33 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:31:33 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk"/>
Oct 26 06:31:33 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:31:33 user nova-compute[74295]:     </disk>
Oct 26 06:31:33 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:31:33 user nova-compute[74295]:       <mac address="fa:16:3e:56:50:7b"/>
Oct 26 06:31:33 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:31:33 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:31:33 user nova-compute[74295]:       <target dev="tap91fed54a-b0"/>
Oct 26 06:31:33 user nova-compute[74295]:     </interface>
Oct 26 06:31:33 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:31:33 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/console.log" append="off"/>
Oct 26 06:31:33 user nova-compute[74295]:     </serial>
Oct 26 06:31:33 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:31:33 user nova-compute[74295]:     <video>
Oct 26 06:31:33 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:31:33 user nova-compute[74295]:     </video>
Oct 26 06:31:33 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:31:33 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:31:33 user nova-compute[74295]:     </rng>
Oct 26 06:31:33 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:31:33 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:31:33 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:31:33 user nova-compute[74295]:     </memballoon>
Oct 26 06:31:33 user nova-compute[74295]:   </devices>
Oct 26 06:31:33 user nova-compute[74295]: </domain>
Oct 26 06:31:33 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-746197758',display_name='tempest-ServersNegativeTestJSON-server-746197758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-746197758',id=17,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beceb88c1357495f9a2a600dc7bbfa1f',ramdisk_id='',reservation_id='r-hdr4kelk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-274276408',owner_user_name='tempest-ServersNegativeTestJSON-274276408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:31:32Z,user_data=None,user_id='91925e095e034d3cb49445f191f910b1',uuid=0440536c-c9ad-439e-aa26-689b945c63ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converting VIF {"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=91fed54a-b08d-47ca-a309-e7d098954c85,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91fed54a-b0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG os_vif [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=91fed54a-b08d-47ca-a309-e7d098954c85,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91fed54a-b0') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35b3353f-035d-55f1-bdf0-931611af4816', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91fed54a-b0, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91fed54a-b0, col_values=(('qos', UUID('22d647c2-2732-4a22-b23d-b4c3c1f16cbe')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91fed54a-b0, col_values=(('external_ids', {'iface-id': '91fed54a-b08d-47ca-a309-e7d098954c85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:50:7b', 'vm-uuid': '0440536c-c9ad-439e-aa26-689b945c63ea'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:33 user nova-compute[74295]: INFO os_vif [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=91fed54a-b08d-47ca-a309-e7d098954c85,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91fed54a-b0')
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] No VIF found with MAC fa:16:3e:56:50:7b, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.neutron [req-99c17874-2f97-4392-bdca-4dc93e4b5d30 req-4626b0f8-02a8-4a32-82d9-1da5b03b1247 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Updated VIF entry in instance network info cache for port 91fed54a-b08d-47ca-a309-e7d098954c85. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:31:33 user nova-compute[74295]: DEBUG nova.network.neutron [req-99c17874-2f97-4392-bdca-4dc93e4b5d30 req-4626b0f8-02a8-4a32-82d9-1da5b03b1247 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Updating instance_info_cache with network_info: [{"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:31:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-99c17874-2f97-4392-bdca-4dc93e4b5d30 req-4626b0f8-02a8-4a32-82d9-1da5b03b1247 service nova] Releasing lock "refresh_cache-0440536c-c9ad-439e-aa26-689b945c63ea" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:31:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-7880128a-69bf-4eda-a501-675d5ceeded0 req-4c63e5e2-5df3-4588-a044-a97088b11e97 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received event network-vif-plugged-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7880128a-69bf-4eda-a501-675d5ceeded0 req-4c63e5e2-5df3-4588-a044-a97088b11e97 service nova] Acquiring lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7880128a-69bf-4eda-a501-675d5ceeded0 req-4c63e5e2-5df3-4588-a044-a97088b11e97 service nova] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7880128a-69bf-4eda-a501-675d5ceeded0 req-4c63e5e2-5df3-4588-a044-a97088b11e97 service nova] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-7880128a-69bf-4eda-a501-675d5ceeded0 req-4c63e5e2-5df3-4588-a044-a97088b11e97 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] No waiting events found dispatching network-vif-plugged-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:35 user nova-compute[74295]: WARNING nova.compute.manager [req-7880128a-69bf-4eda-a501-675d5ceeded0 req-4c63e5e2-5df3-4588-a044-a97088b11e97 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received unexpected event network-vif-plugged-91fed54a-b08d-47ca-a309-e7d098954c85 for instance with vm_state building and task_state spawning.
Oct 26 06:31:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-f7ad39d0-8d63-4c91-8eee-b2f56831ca52 req-44c2fa1b-cb38-4a0d-8a26-19a7cb03636f service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received event network-vif-plugged-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f7ad39d0-8d63-4c91-8eee-b2f56831ca52 req-44c2fa1b-cb38-4a0d-8a26-19a7cb03636f service nova] Acquiring lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f7ad39d0-8d63-4c91-8eee-b2f56831ca52 req-44c2fa1b-cb38-4a0d-8a26-19a7cb03636f service nova] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f7ad39d0-8d63-4c91-8eee-b2f56831ca52 req-44c2fa1b-cb38-4a0d-8a26-19a7cb03636f service nova] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-f7ad39d0-8d63-4c91-8eee-b2f56831ca52 req-44c2fa1b-cb38-4a0d-8a26-19a7cb03636f service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] No waiting events found dispatching network-vif-plugged-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:37 user nova-compute[74295]: WARNING nova.compute.manager [req-f7ad39d0-8d63-4c91-8eee-b2f56831ca52 req-44c2fa1b-cb38-4a0d-8a26-19a7cb03636f service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received unexpected event network-vif-plugged-91fed54a-b08d-47ca-a309-e7d098954c85 for instance with vm_state building and task_state spawning.
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:31:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Instance spawned successfully.
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:31:37 user nova-compute[74295]: INFO nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Took 6.21 seconds to spawn the instance on the hypervisor.
Oct 26 06:31:37 user nova-compute[74295]: DEBUG nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:31:38 user nova-compute[74295]: INFO nova.compute.manager [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Took 7.17 seconds to build instance.
Oct 26 06:31:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-51cad8a8-3ee4-4329-a571-00b6eb5fade7 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "0440536c-c9ad-439e-aa26-689b945c63ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.280s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-b767b655-2439-4582-83d8-6a5502f8d86b req-47582d3e-4cac-4deb-a085-464f862ea8f6 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-changed-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-b767b655-2439-4582-83d8-6a5502f8d86b req-47582d3e-4cac-4deb-a085-464f862ea8f6 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Refreshing instance network info cache due to event network-changed-2b5d323f-8884-4acb-a176-40dfcf957402. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b767b655-2439-4582-83d8-6a5502f8d86b req-47582d3e-4cac-4deb-a085-464f862ea8f6 service nova] Acquiring lock "refresh_cache-cf010631-119f-42b0-a356-a645b27e4081" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b767b655-2439-4582-83d8-6a5502f8d86b req-47582d3e-4cac-4deb-a085-464f862ea8f6 service nova] Acquired lock "refresh_cache-cf010631-119f-42b0-a356-a645b27e4081" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-b767b655-2439-4582-83d8-6a5502f8d86b req-47582d3e-4cac-4deb-a085-464f862ea8f6 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Refreshing network info cache for port 2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-b767b655-2439-4582-83d8-6a5502f8d86b req-47582d3e-4cac-4deb-a085-464f862ea8f6 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Updated VIF entry in instance network info cache for port 2b5d323f-8884-4acb-a176-40dfcf957402. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-b767b655-2439-4582-83d8-6a5502f8d86b req-47582d3e-4cac-4deb-a085-464f862ea8f6 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Updating instance_info_cache with network_info: [{"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b767b655-2439-4582-83d8-6a5502f8d86b req-47582d3e-4cac-4deb-a085-464f862ea8f6 service nova] Releasing lock "refresh_cache-cf010631-119f-42b0-a356-a645b27e4081" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG nova.objects.instance [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'flavor' on Instance uuid cf010631-119f-42b0-a356-a645b27e4081 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:53 user nova-compute[74295]: INFO nova.compute.manager [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Attaching volume f4d75b2c-b5c2-46ca-b024-e65d7fd922bd to /dev/vdb
Oct 26 06:31:53 user nova-compute[74295]: DEBUG os_brick.utils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f505fac9-dd55-406d-96f3-df4b51424160]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c8aca5-bb8a-406b-92b2-246237c1e3c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0d8045-7492-4e6d-a242-7ee1e47b1a04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65547c3-92f8-4995-b64d-c13d781a6c0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:31:53 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:31:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0495008-0977-4671-b5c8-7eb821fe2d8d]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG os_brick.utils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Updating existing volume attachment record: af398317-aab9-44ed-8215-5de8e02230b8 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:31:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 06:31:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-053521f5-e137-4c87-ad6e-304b2e195e2d req-a696b465-f2a6-4de8-b946-568cac746fcd service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received event network-changed-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-053521f5-e137-4c87-ad6e-304b2e195e2d req-a696b465-f2a6-4de8-b946-568cac746fcd service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Refreshing instance network info cache due to event network-changed-fc3fa6ad-7873-40a2-98cb-0732397e2450. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:31:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-053521f5-e137-4c87-ad6e-304b2e195e2d req-a696b465-f2a6-4de8-b946-568cac746fcd service nova] Acquiring lock "refresh_cache-1229385f-194e-482e-ac54-ca9cc2591edd" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:31:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-053521f5-e137-4c87-ad6e-304b2e195e2d req-a696b465-f2a6-4de8-b946-568cac746fcd service nova] Acquired lock "refresh_cache-1229385f-194e-482e-ac54-ca9cc2591edd" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:31:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-053521f5-e137-4c87-ad6e-304b2e195e2d req-a696b465-f2a6-4de8-b946-568cac746fcd service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Refreshing network info cache for port fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:31:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:56 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 06:31:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 06:31:56 user nova-compute[74295]: DEBUG nova.network.neutron [req-053521f5-e137-4c87-ad6e-304b2e195e2d req-a696b465-f2a6-4de8-b946-568cac746fcd service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Updated VIF entry in instance network info cache for port fc3fa6ad-7873-40a2-98cb-0732397e2450. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:31:56 user nova-compute[74295]: DEBUG nova.network.neutron [req-053521f5-e137-4c87-ad6e-304b2e195e2d req-a696b465-f2a6-4de8-b946-568cac746fcd service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Updating instance_info_cache with network_info: [{"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:31:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-053521f5-e137-4c87-ad6e-304b2e195e2d req-a696b465-f2a6-4de8-b946-568cac746fcd service nova] Releasing lock "refresh_cache-1229385f-194e-482e-ac54-ca9cc2591edd" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:31:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lazy-loading 'flavor' on Instance uuid 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:57 user nova-compute[74295]: INFO nova.compute.manager [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Attaching volume 7927ba84-e82d-4502-b7de-9d9e78742ad5 to /dev/vdb
Oct 26 06:31:57 user nova-compute[74295]: DEBUG os_brick.utils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[585d9fa7-4756-4c58-b32e-896a0429cc04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52fbe22-6fc9-4cd0-a36b-bbd9e872b832]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c647b9f4-5431-4f31-b0a7-0ff5da55f7ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c104a7f9-bfab-4d6c-880c-c35b12874cee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:31:57 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4306df4f-cad4-4d50-b82f-0ca6061b6dce]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG os_brick.utils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Updating existing volume attachment record: 16c12fd2-77f0-430b-9ecc-a33ccb92943e {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:31:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "48f22cde-4b90-43de-aba1-968afce2ddce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "48f22cde-4b90-43de-aba1-968afce2ddce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:58 user nova-compute[74295]: INFO nova.compute.manager [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Terminating instance
Oct 26 06:31:58 user nova-compute[74295]: DEBUG nova.compute.manager [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-14c54bdc-e4c8-41d0-b58b-94a611367789 req-494356a3-9c28-4e71-a2c5-18f181e7db54 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received event network-vif-unplugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-14c54bdc-e4c8-41d0-b58b-94a611367789 req-494356a3-9c28-4e71-a2c5-18f181e7db54 service nova] Acquiring lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-14c54bdc-e4c8-41d0-b58b-94a611367789 req-494356a3-9c28-4e71-a2c5-18f181e7db54 service nova] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-14c54bdc-e4c8-41d0-b58b-94a611367789 req-494356a3-9c28-4e71-a2c5-18f181e7db54 service nova] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-14c54bdc-e4c8-41d0-b58b-94a611367789 req-494356a3-9c28-4e71-a2c5-18f181e7db54 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] No waiting events found dispatching network-vif-unplugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-14c54bdc-e4c8-41d0-b58b-94a611367789 req-494356a3-9c28-4e71-a2c5-18f181e7db54 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received event network-vif-unplugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Instance destroyed successfully.
Oct 26 06:31:59 user nova-compute[74295]: DEBUG nova.objects.instance [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lazy-loading 'resources' on Instance uuid 48f22cde-4b90-43de-aba1-968afce2ddce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1273585285',display_name='tempest-VolumesAdminNegativeTest-server-1273585285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1273585285',id=13,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14561432954b4ce78599f0bd131a1863',ramdisk_id='',reservation_id='r-zulizrgp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-417079322',owner_user_name='tempest-VolumesAdminNegativeTest-417079322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:29:56Z,user_data=None,user_id='4691863b37da4920a7d50434b9f4584c',uuid=48f22cde-4b90-43de-aba1-968afce2ddce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converting VIF {"id": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "address": "fa:16:3e:82:aa:ff", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c66b6d2-8f", "ovs_interfaceid": "2c66b6d2-8f1f-4c4c-9a1c-da0b26028446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:ff,bridge_name='br-int',has_traffic_filtering=True,id=2c66b6d2-8f1f-4c4c-9a1c-da0b26028446,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c66b6d2-8f') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG os_vif [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:ff,bridge_name='br-int',has_traffic_filtering=True,id=2c66b6d2-8f1f-4c4c-9a1c-da0b26028446,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c66b6d2-8f') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c66b6d2-8f, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6ee7b69-4cf7-4ace-9157-84679f8e6a85) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:31:59 user nova-compute[74295]: INFO os_vif [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:ff,bridge_name='br-int',has_traffic_filtering=True,id=2c66b6d2-8f1f-4c4c-9a1c-da0b26028446,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c66b6d2-8f')
Oct 26 06:31:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Deleting instance files /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce_del
Oct 26 06:31:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Deletion of /opt/stack/data/nova/instances/48f22cde-4b90-43de-aba1-968afce2ddce_del complete
Oct 26 06:31:59 user nova-compute[74295]: INFO nova.compute.manager [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 26 06:31:59 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:31:59 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:32:00 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:32:00 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Took 0.87 seconds to deallocate network for instance.
Oct 26 06:32:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-9a1a8098-210e-4f35-85f4-4a7c29039fb1 req-6dcc15eb-7849-40af-aa29-be9bb055d0a1 service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received event network-vif-deleted-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-568dfbe7-af07-483f-946a-b0a368670853 req-b8d532cf-c60a-4abe-812f-53ae218d004a service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received event network-vif-plugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-568dfbe7-af07-483f-946a-b0a368670853 req-b8d532cf-c60a-4abe-812f-53ae218d004a service nova] Acquiring lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-568dfbe7-af07-483f-946a-b0a368670853 req-b8d532cf-c60a-4abe-812f-53ae218d004a service nova] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-568dfbe7-af07-483f-946a-b0a368670853 req-b8d532cf-c60a-4abe-812f-53ae218d004a service nova] Lock "48f22cde-4b90-43de-aba1-968afce2ddce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-568dfbe7-af07-483f-946a-b0a368670853 req-b8d532cf-c60a-4abe-812f-53ae218d004a service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] No waiting events found dispatching network-vif-plugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:01 user nova-compute[74295]: WARNING nova.compute.manager [req-568dfbe7-af07-483f-946a-b0a368670853 req-b8d532cf-c60a-4abe-812f-53ae218d004a service nova] [instance: 48f22cde-4b90-43de-aba1-968afce2ddce] Received unexpected event network-vif-plugged-2c66b6d2-8f1f-4c4c-9a1c-da0b26028446 for instance with vm_state deleted and task_state None.
Oct 26 06:32:01 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:32:01 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:32:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:01 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Deleted allocations for instance 48f22cde-4b90-43de-aba1-968afce2ddce
Oct 26 06:32:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-68326362-90dd-4c72-b1c5-3269b982809e tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "48f22cde-4b90-43de-aba1-968afce2ddce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.722s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:02 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:32:02 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:32:02 user nova-compute[74295]: INFO nova.compute.claims [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Claim successful on node user
Oct 26 06:32:03 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:32:03 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:32:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG nova.policy [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a23e0e206f504aaeb7909b322ea2d563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c9296eef7f4c45b5275803942de414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:32:03 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Creating image(s)
Oct 26 06:32:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "/opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "/opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "/opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.330s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.241s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk 1073741824" returned: 0 in 0.056s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Successfully created port: c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.168s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Cannot resize image /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Ensure instance console log exists: /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:04 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Successfully updated port: c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-5415c053-03df-42bf-98c2-bea6d388a735 req-cff661f7-6951-4f96-b62d-7f5e4ca09955 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received event network-changed-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-5415c053-03df-42bf-98c2-bea6d388a735 req-cff661f7-6951-4f96-b62d-7f5e4ca09955 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Refreshing instance network info cache due to event network-changed-c9f250c3-be94-4dd5-bee9-8c5b55470cf8. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5415c053-03df-42bf-98c2-bea6d388a735 req-cff661f7-6951-4f96-b62d-7f5e4ca09955 service nova] Acquiring lock "refresh_cache-d98449c4-fbe5-44cc-82d4-d5d88b28c68d" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5415c053-03df-42bf-98c2-bea6d388a735 req-cff661f7-6951-4f96-b62d-7f5e4ca09955 service nova] Acquired lock "refresh_cache-d98449c4-fbe5-44cc-82d4-d5d88b28c68d" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-5415c053-03df-42bf-98c2-bea6d388a735 req-cff661f7-6951-4f96-b62d-7f5e4ca09955 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Refreshing network info cache for port c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "refresh_cache-d98449c4-fbe5-44cc-82d4-d5d88b28c68d" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-5415c053-03df-42bf-98c2-bea6d388a735 req-cff661f7-6951-4f96-b62d-7f5e4ca09955 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-5415c053-03df-42bf-98c2-bea6d388a735 req-cff661f7-6951-4f96-b62d-7f5e4ca09955 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5415c053-03df-42bf-98c2-bea6d388a735 req-cff661f7-6951-4f96-b62d-7f5e4ca09955 service nova] Releasing lock "refresh_cache-d98449c4-fbe5-44cc-82d4-d5d88b28c68d" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquired lock "refresh_cache-d98449c4-fbe5-44cc-82d4-d5d88b28c68d" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Updating instance_info_cache with network_info: [{"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Releasing lock "refresh_cache-d98449c4-fbe5-44cc-82d4-d5d88b28c68d" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Instance network_info: |[{"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Start _get_guest_xml network_info=[{"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:32:05 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:32:05 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-793137887',display_name='tempest-AttachVolumeNegativeTest-server-793137887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-793137887',id=18,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoXQDNNys5WRJuSAj6LTcfyRa23W36vRNeTN5L6+z3ea7EplgAeFyPLh8c6LjjzeEDVMHFByhonCmIFQscAgZrSq3V9ECTgJGyjTX49C4erl7zLdxDfLBFnTGkjLKGM2Q==',key_name='tempest-keypair-1122912892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-ybar3ss4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=d98449c4-fbe5-44cc-82d4-d5d88b28c68d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:32:05 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:13:45,bridge_name='br-int',has_traffic_filtering=True,id=c9f250c3-be94-4dd5-bee9-8c5b55470cf8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9f250c3-be') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'pci_devices' on Instance uuid d98449c4-fbe5-44cc-82d4-d5d88b28c68d {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:32:06 user nova-compute[74295]:   <uuid>d98449c4-fbe5-44cc-82d4-d5d88b28c68d</uuid>
Oct 26 06:32:06 user nova-compute[74295]:   <name>instance-00000012</name>
Oct 26 06:32:06 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:32:06 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:32:06 user nova-compute[74295]:   <metadata>
Oct 26 06:32:06 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:32:06 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:32:06 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeNegativeTest-server-793137887</nova:name>
Oct 26 06:32:06 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:32:05</nova:creationTime>
Oct 26 06:32:06 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:32:06 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:32:06 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:32:06 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:32:06 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:32:06 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:32:06 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:32:06 user nova-compute[74295]:       <nova:owner>
Oct 26 06:32:06 user nova-compute[74295]:         <nova:user uuid="a23e0e206f504aaeb7909b322ea2d563">tempest-AttachVolumeNegativeTest-1112300090-project-member</nova:user>
Oct 26 06:32:06 user nova-compute[74295]:         <nova:project uuid="c2c9296eef7f4c45b5275803942de414">tempest-AttachVolumeNegativeTest-1112300090</nova:project>
Oct 26 06:32:06 user nova-compute[74295]:       </nova:owner>
Oct 26 06:32:06 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:32:06 user nova-compute[74295]:       <nova:ports>
Oct 26 06:32:06 user nova-compute[74295]:         <nova:port uuid="c9f250c3-be94-4dd5-bee9-8c5b55470cf8">
Oct 26 06:32:06 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 06:32:06 user nova-compute[74295]:         </nova:port>
Oct 26 06:32:06 user nova-compute[74295]:       </nova:ports>
Oct 26 06:32:06 user nova-compute[74295]:     </nova:instance>
Oct 26 06:32:06 user nova-compute[74295]:   </metadata>
Oct 26 06:32:06 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:32:06 user nova-compute[74295]:     <system>
Oct 26 06:32:06 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:32:06 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:32:06 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:32:06 user nova-compute[74295]:       <entry name="serial">d98449c4-fbe5-44cc-82d4-d5d88b28c68d</entry>
Oct 26 06:32:06 user nova-compute[74295]:       <entry name="uuid">d98449c4-fbe5-44cc-82d4-d5d88b28c68d</entry>
Oct 26 06:32:06 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:32:06 user nova-compute[74295]:     </system>
Oct 26 06:32:06 user nova-compute[74295]:   </sysinfo>
Oct 26 06:32:06 user nova-compute[74295]:   <os>
Oct 26 06:32:06 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:32:06 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:32:06 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:32:06 user nova-compute[74295]:   </os>
Oct 26 06:32:06 user nova-compute[74295]:   <features>
Oct 26 06:32:06 user nova-compute[74295]:     <acpi/>
Oct 26 06:32:06 user nova-compute[74295]:     <apic/>
Oct 26 06:32:06 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:32:06 user nova-compute[74295]:   </features>
Oct 26 06:32:06 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:32:06 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:32:06 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:32:06 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:32:06 user nova-compute[74295]:   </clock>
Oct 26 06:32:06 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:32:06 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:32:06 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:32:06 user nova-compute[74295]:   </cpu>
Oct 26 06:32:06 user nova-compute[74295]:   <devices>
Oct 26 06:32:06 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:32:06 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:32:06 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk"/>
Oct 26 06:32:06 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:32:06 user nova-compute[74295]:     </disk>
Oct 26 06:32:06 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:32:06 user nova-compute[74295]:       <mac address="fa:16:3e:74:13:45"/>
Oct 26 06:32:06 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:32:06 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:32:06 user nova-compute[74295]:       <target dev="tapc9f250c3-be"/>
Oct 26 06:32:06 user nova-compute[74295]:     </interface>
Oct 26 06:32:06 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:32:06 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/console.log" append="off"/>
Oct 26 06:32:06 user nova-compute[74295]:     </serial>
Oct 26 06:32:06 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:32:06 user nova-compute[74295]:     <video>
Oct 26 06:32:06 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:32:06 user nova-compute[74295]:     </video>
Oct 26 06:32:06 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:32:06 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:32:06 user nova-compute[74295]:     </rng>
Oct 26 06:32:06 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:32:06 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:32:06 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:32:06 user nova-compute[74295]:     </memballoon>
Oct 26 06:32:06 user nova-compute[74295]:   </devices>
Oct 26 06:32:06 user nova-compute[74295]: </domain>
Oct 26 06:32:06 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-793137887',display_name='tempest-AttachVolumeNegativeTest-server-793137887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-793137887',id=18,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoXQDNNys5WRJuSAj6LTcfyRa23W36vRNeTN5L6+z3ea7EplgAeFyPLh8c6LjjzeEDVMHFByhonCmIFQscAgZrSq3V9ECTgJGyjTX49C4erl7zLdxDfLBFnTGkjLKGM2Q==',key_name='tempest-keypair-1122912892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-ybar3ss4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=d98449c4-fbe5-44cc-82d4-d5d88b28c68d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:13:45,bridge_name='br-int',has_traffic_filtering=True,id=c9f250c3-be94-4dd5-bee9-8c5b55470cf8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9f250c3-be') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG os_vif [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:13:45,bridge_name='br-int',has_traffic_filtering=True,id=c9f250c3-be94-4dd5-bee9-8c5b55470cf8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9f250c3-be') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07cb1f7d-728c-5c55-944e-469cbfdb6d99', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9f250c3-be, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9f250c3-be, col_values=(('qos', UUID('d09bd144-17b9-4721-b134-029e61f848e2')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9f250c3-be, col_values=(('external_ids', {'iface-id': 'c9f250c3-be94-4dd5-bee9-8c5b55470cf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:13:45', 'vm-uuid': 'd98449c4-fbe5-44cc-82d4-d5d88b28c68d'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:32:06 user nova-compute[74295]: INFO os_vif [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:13:45,bridge_name='br-int',has_traffic_filtering=True,id=c9f250c3-be94-4dd5-bee9-8c5b55470cf8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9f250c3-be')
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No VIF found with MAC fa:16:3e:74:13:45, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updating instance_info_cache with network_info: [{"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:32:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-93f0089d-cc41-4f0a-915d-fccbf633cb96 req-8c5c8dfb-859f-42e8-b201-00cc7b139c7e service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received event network-vif-plugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-93f0089d-cc41-4f0a-915d-fccbf633cb96 req-8c5c8dfb-859f-42e8-b201-00cc7b139c7e service nova] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-93f0089d-cc41-4f0a-915d-fccbf633cb96 req-8c5c8dfb-859f-42e8-b201-00cc7b139c7e service nova] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-93f0089d-cc41-4f0a-915d-fccbf633cb96 req-8c5c8dfb-859f-42e8-b201-00cc7b139c7e service nova] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-93f0089d-cc41-4f0a-915d-fccbf633cb96 req-8c5c8dfb-859f-42e8-b201-00cc7b139c7e service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] No waiting events found dispatching network-vif-plugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:07 user nova-compute[74295]: WARNING nova.compute.manager [req-93f0089d-cc41-4f0a-915d-fccbf633cb96 req-8c5c8dfb-859f-42e8-b201-00cc7b139c7e service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received unexpected event network-vif-plugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 for instance with vm_state building and task_state spawning.
Oct 26 06:32:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-dafa4203-519f-459b-9121-85cbef667a8a req-c0ce3e15-ef69-4d92-a3f7-64ad73a22bf7 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received event network-vif-plugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dafa4203-519f-459b-9121-85cbef667a8a req-c0ce3e15-ef69-4d92-a3f7-64ad73a22bf7 service nova] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dafa4203-519f-459b-9121-85cbef667a8a req-c0ce3e15-ef69-4d92-a3f7-64ad73a22bf7 service nova] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dafa4203-519f-459b-9121-85cbef667a8a req-c0ce3e15-ef69-4d92-a3f7-64ad73a22bf7 service nova] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-dafa4203-519f-459b-9121-85cbef667a8a req-c0ce3e15-ef69-4d92-a3f7-64ad73a22bf7 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] No waiting events found dispatching network-vif-plugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:09 user nova-compute[74295]: WARNING nova.compute.manager [req-dafa4203-519f-459b-9121-85cbef667a8a req-c0ce3e15-ef69-4d92-a3f7-64ad73a22bf7 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received unexpected event network-vif-plugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 for instance with vm_state building and task_state spawning.
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:32:10 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Instance spawned successfully.
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:10 user nova-compute[74295]: INFO nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Took 6.75 seconds to spawn the instance on the hypervisor.
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:10 user nova-compute[74295]: INFO nova.compute.manager [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Took 7.73 seconds to build instance.
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c76d301-ffca-4351-a68b-0933204a940b tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.855s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:32:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUPBDXFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:32:14 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:32:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:14 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:32:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:14 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ad90c9-07bb-457e-bf16-c50ceda1f8aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:32:14 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e027382-08fa-48ad-95bc-f6640247fc42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd] added
Oct 26 06:32:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c9b002-a38f-490a-8bf7-4ea63de6f252]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[077e42df-4c9a-4cc9-b900-4338ae1480b5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUPBDXFc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUPBDXFc" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6012bcdf-edd1-4690-8283-250a541ebf61]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vUPBDXFc'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:32:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=6994MB free_disk=25.295848846435547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c59e205-60b7-46fe-abe4-58baf07b161f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d141bf8d-c682-489e-ab37-e8e0465a0fbe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:15 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:15 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[67636ecb-1163-4179-890e-b4c841722c6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260]
Oct 26 06:32:15 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260] successful.
Oct 26 06:32:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Applying migration context for instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 as it has an incoming, in-progress migration 288bbde7-fba4-4018-867d-86cae276705e. Migration status is finished {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 06:32:15 user nova-compute[74295]: INFO nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating resource usage from migration 288bbde7-fba4-4018-867d-86cae276705e
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3531612f-af68-48d7-9c00-9dc42e8181d8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60380e9-b358-4d47-96f1-9c5178a23824]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:15 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:15 user nova-compute[74295]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:15 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:15 user nova-compute[74295]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.873s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9545ee57-5cbf-4b90-9e45-27ed99583c54]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 88335730-9d04-4614-8c24-f0c3957418f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cf010631-119f-42b0-a356-a645b27e4081 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1229385f-194e-482e-ac54-ca9cc2591edd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Migration 288bbde7-fba4-4018-867d-86cae276705e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1f13ee5-22e7-466c-a117-ae4a707ad2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 0440536c-c9ad-439e-aa26-689b945c63ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:32:15 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.114s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUPBDXFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.923s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== connect_volume: return (1925ms) {'type': 'block', 'scsi_wwn': '23662356438303938', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662356438303938', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.objects.instance [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'flavor' on Instance uuid cf010631-119f-42b0-a356-a645b27e4081 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:32:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:32:16 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:32:16 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:32:16 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:32:16 user nova-compute[74295]:   <serial>f4d75b2c-b5c2-46ca-b024-e65d7fd922bd</serial>
Oct 26 06:32:16 user nova-compute[74295]: </disk>
Oct 26 06:32:16 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:32:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No VIF found with MAC fa:16:3e:59:49:33, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:32:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-eeaca40f-a04b-4266-95c4-69ff145ceaa4 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.373s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:18 user nova-compute[74295]: INFO nova.compute.manager [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Rebuilding instance
Oct 26 06:32:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:32:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a634e4b4-6842-4eeb-8f9f-813b54134a66 req-cca641c1-7c39-46e8-92c2-119827cb2e81 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-unplugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a634e4b4-6842-4eeb-8f9f-813b54134a66 req-cca641c1-7c39-46e8-92c2-119827cb2e81 service nova] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a634e4b4-6842-4eeb-8f9f-813b54134a66 req-cca641c1-7c39-46e8-92c2-119827cb2e81 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a634e4b4-6842-4eeb-8f9f-813b54134a66 req-cca641c1-7c39-46e8-92c2-119827cb2e81 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a634e4b4-6842-4eeb-8f9f-813b54134a66 req-cca641c1-7c39-46e8-92c2-119827cb2e81 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] No waiting events found dispatching network-vif-unplugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:19 user nova-compute[74295]: WARNING nova.compute.manager [req-a634e4b4-6842-4eeb-8f9f-813b54134a66 req-cca641c1-7c39-46e8-92c2-119827cb2e81 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received unexpected event network-vif-unplugged-2b5d323f-8884-4acb-a176-40dfcf957402 for instance with vm_state active and task_state rebuilding.
Oct 26 06:32:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cf010631-119f-42b0-a356-a645b27e4081] Instance destroyed successfully.
Oct 26 06:32:20 user nova-compute[74295]: INFO nova.compute.manager [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Detaching volume f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:32:20 user nova-compute[74295]: INFO nova.virt.block_device [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Attempting to driver detach volume f4d75b2c-b5c2-46ca-b024-e65d7fd922bd from mountpoint /dev/vdb
Oct 26 06:32:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Attempting to detach device vdb from instance cf010631-119f-42b0-a356-a645b27e4081 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:32:20 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:32:20 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:32:20 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:32:20 user nova-compute[74295]:   <serial>f4d75b2c-b5c2-46ca-b024-e65d7fd922bd</serial>
Oct 26 06:32:20 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:32:20 user nova-compute[74295]: </disk>
Oct 26 06:32:20 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:32:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully detached device vdb from instance cf010631-119f-42b0-a356-a645b27e4081 from the persistent domain config.
Oct 26 06:32:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUPBDXFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:32:20 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebce5616-6218-40b5-98f3-59d452677e5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:32:20 user nova-compute[74295]: No targets found.
Oct 26 06:32:20 user nova-compute[74295]: iSNS:
Oct 26 06:32:20 user nova-compute[74295]: No targets found.
Oct 26 06:32:20 user nova-compute[74295]: STATIC:
Oct 26 06:32:20 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:32:20 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:32:20 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:32:20 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:32:20 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:32:20 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:32:20 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:32:20 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:32:20 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:32:20 user nova-compute[74295]: FIRMWARE:
Oct 26 06:32:20 user nova-compute[74295]: No targets found.
Oct 26 06:32:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:32:20 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:32:20 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a756e35-9d2d-4391-b09f-d3f489d9885a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c03e7c-599d-4eb8-a9a9-26bcf5395bad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:20 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:20 user nova-compute[74295]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:20 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:20 user nova-compute[74295]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1ec790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30af8b3-f822-49b0-a672-f9b467bdddb6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eb602a-234d-40af-a8d2-68b176f0468f]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[22601aa6-06b7-4480-b0dd-574194df0442]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[37554323-c698-4649-9556-2cfcc4456311]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5564010f-f8ce-4ea4-af3b-81cab0240d40]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3d4a45-3ce3-4da8-b347-fafd41b6f486]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260]
Oct 26 06:32:20 user nova-compute[74295]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260] successful.
Oct 26 06:32:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a52cf0-7e74-4286-861c-3f41630635f5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== disconnect_volume: return (352ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:32:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cf010631-119f-42b0-a356-a645b27e4081] Instance destroyed successfully.
Oct 26 06:32:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-213606875',display_name='tempest-ServerActionsTestOtherA-server-1405397235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-213606875',id=14,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtH+FO/rcPVmXXNwudgrvBLEMmMcqmnAHUrdcVJlWtaZpsycsfMyvP1tJmmBYEi4UMNSFlb3baPyXSYG4kOajpOED31FcaPy44SBBtSx6sYgvc6+6JiuCiXwwpnNliueA==',key_name='tempest-keypair-1139203649',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-k4edxa0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:32:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=cf010631-119f-42b0-a356-a645b27e4081,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_vif [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b5d323f-88, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f028927-479f-4cdc-9b0b-9a352b8455bf) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:32:21 user nova-compute[74295]: INFO os_vif [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88')
Oct 26 06:32:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUPBDXFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:32:21 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a424564d-6b0c-4ffd-86ec-1700fad5b290]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:32:21 user nova-compute[74295]: No targets found.
Oct 26 06:32:21 user nova-compute[74295]: iSNS:
Oct 26 06:32:21 user nova-compute[74295]: No targets found.
Oct 26 06:32:21 user nova-compute[74295]: STATIC:
Oct 26 06:32:21 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:32:21 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:32:21 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:32:21 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:32:21 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:32:21 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:32:21 user nova-compute[74295]: FIRMWARE:
Oct 26 06:32:21 user nova-compute[74295]: No targets found.
Oct 26 06:32:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:32:21 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:32:21 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-182828f4-5e0e-4c9e-93a5-51fa14e87dc0 req-4c27ea81-2e3f-40b2-97e3-ceac25c77e28 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-182828f4-5e0e-4c9e-93a5-51fa14e87dc0 req-4c27ea81-2e3f-40b2-97e3-ceac25c77e28 service nova] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-182828f4-5e0e-4c9e-93a5-51fa14e87dc0 req-4c27ea81-2e3f-40b2-97e3-ceac25c77e28 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-182828f4-5e0e-4c9e-93a5-51fa14e87dc0 req-4c27ea81-2e3f-40b2-97e3-ceac25c77e28 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-182828f4-5e0e-4c9e-93a5-51fa14e87dc0 req-4c27ea81-2e3f-40b2-97e3-ceac25c77e28 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] No waiting events found dispatching network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:21 user nova-compute[74295]: WARNING nova.compute.manager [req-182828f4-5e0e-4c9e-93a5-51fa14e87dc0 req-4c27ea81-2e3f-40b2-97e3-ceac25c77e28 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received unexpected event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 for instance with vm_state active and task_state rebuilding.
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[631f80e7-d93e-4b8c-91f3-64c2495b0737]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ec321e-8380-421c-b395-1665348b4d3b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:21 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:21 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3588799b40>, {}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Disconnecting from: [] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.100s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== disconnect_volume: return (102ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:32:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Deleting instance files /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081_del
Oct 26 06:32:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Deletion of /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081_del complete
Oct 26 06:32:21 user nova-compute[74295]: INFO nova.virt.block_device [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Booting with volume f4d75b2c-b5c2-46ca-b024-e65d7fd922bd at /dev/vdb
Oct 26 06:32:21 user nova-compute[74295]: DEBUG os_brick.utils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:32:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33c0143-a7b8-447d-a5ae-82bd74b338b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aafdca5-7947-4c34-a09b-fe404d6d4ce0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb54f47c-ba85-4389-b2ae-1dd5531df61e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf609b-5d53-4e1b-a7dd-9d7dc8919bdd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:32:22 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e16fbb-a6c8-4593-bc9b-d82f1051dbde]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.utils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Updating existing volume attachment record: f873ade4-cdc4-46e6-884f-22d639afafdc {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pcCWVFSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:32:22 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:22 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:22 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89c774d-7e7e-4c54-bf5e-322b0f405b33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:32:22 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafcf065-4d8a-4636-894c-8300422f1c23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5] added
Oct 26 06:32:22 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a21bb9-16d2-4659-9f99-acea414dc7c8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f4d691-c97e-4014-b3d7-a3a1817c659b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pcCWVFSQ {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pcCWVFSQ" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff71a99-7932-4db1-b741-4895773ff017]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pcCWVFSQ'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9448e6cc-fab1-48bc-a687-a3aa195b354c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d243f71-2236-4ef3-8ad7-3ac5722a0b50]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:22 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:22 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:22 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:22 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2018b875-9e33-4a90-96c8-0d37a263d780]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5, portal: 172.16.0.220,3260]
Oct 26 06:32:23 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5, portal: 172.16.0.220,3260] successful.
Oct 26 06:32:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8de614-6148-4514-a5b6-ca9abfc722d8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6005cf4-6636-4461-bc74-0feea0fc1561]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:23 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:23 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:23 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:23 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:23 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[13083d21-004b-4684-8f43-a696256b2e8e]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:32:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pcCWVFSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:32:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23863356362353965', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:32:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863356362353965', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:32:24 user nova-compute[74295]: DEBUG nova.objects.instance [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lazy-loading 'flavor' on Instance uuid 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:32:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:32:24 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:32:24 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:32:24 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:32:24 user nova-compute[74295]:   <serial>7927ba84-e82d-4502-b7de-9d9e78742ad5</serial>
Oct 26 06:32:24 user nova-compute[74295]: </disk>
Oct 26 06:32:24 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:32:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] No VIF found with MAC fa:16:3e:0d:eb:54, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:32:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-89b2df94-0810-45c3-9c20-0238a3de2c45 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.494s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lazy-loading 'flavor' on Instance uuid 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:28 user nova-compute[74295]: INFO nova.compute.manager [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Attaching volume 2c5eb421-01be-4b09-8a4d-0a67a21a3298 to /dev/vdc
Oct 26 06:32:28 user nova-compute[74295]: DEBUG os_brick.utils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b2125b-f966-4e28-ae84-31c5a4ead01b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c92afb-ddf1-4b14-9f58-7538a04fc7f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b9fca8-de81-47e5-99c3-1bde39453cb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[067d6b24-9575-4a1a-a9d2-61295ed111db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:32:28 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:32:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f07e00c-8552-4c7d-b35f-0a4ed44e8c8e]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG os_brick.utils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:32:28 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Updating existing volume attachment record: ca9a064a-cba6-41df-a2ab-c0a423c12c3f {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:32:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:32:43 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Creating image(s)
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.207s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk 1073741824" returned: 0 in 0.064s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Cannot resize image /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Ensure instance console log exists: /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Start _get_guest_xml network_info=[{"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'f873ade4-cdc4-46e6-884f-22d639afafdc', 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUPBDXFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cf010631-119f-42b0-a356-a645b27e4081', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 'serial': 'f4d75b2c-b5c2-46ca-b024-e65d7fd922bd'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:32:43 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 06:32:43 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:32:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.objects.instance [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'vcpu_model' on Instance uuid cf010631-119f-42b0-a356-a645b27e4081 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUPBDXFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:32:44 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:44 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:44 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3365900-fe23-4503-b92d-ee9b1958ed50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:32:44 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a706d3-53f6-4736-b9ef-8cb95120f8db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd] added
Oct 26 06:32:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5cc174-9bff-4cf1-9fc4-18aa66110e32]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee73bec-56ca-4de2-b79e-e945d36757f3]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUPBDXFc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUPBDXFc" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d35ab-1792-4898-8b74-85cd56132417]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vUPBDXFc'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0792d6bc-6004-4e06-8f9e-84afbe211484]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de55084-33d9-4f10-a10f-8b8039db62c7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d50792-9e6c-4125-a495-dd88db89b483]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260]
Oct 26 06:32:44 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260] successful.
Oct 26 06:32:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0335367a-d6dc-43ff-848e-e9d6aa64c141]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc58c8a4-96e6-4d39-9661-bee96d935b18]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:44 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1380086-b47a-485d-894b-aefca498bed7]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:32:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUPBDXFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23662356438303938', 'path': '/dev/sde'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662356438303938', 'path': '/dev/sde'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-213606875',display_name='tempest-ServerActionsTestOtherA-server-1405397235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-213606875',id=14,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtH+FO/rcPVmXXNwudgrvBLEMmMcqmnAHUrdcVJlWtaZpsycsfMyvP1tJmmBYEi4UMNSFlb3baPyXSYG4kOajpOED31FcaPy44SBBtSx6sYgvc6+6JiuCiXwwpnNliueA==',key_name='tempest-keypair-1139203649',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-k4edxa0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=cf010631-119f-42b0-a356-a645b27e4081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:32:45 user nova-compute[74295]:   <uuid>cf010631-119f-42b0-a356-a645b27e4081</uuid>
Oct 26 06:32:45 user nova-compute[74295]:   <name>instance-0000000e</name>
Oct 26 06:32:45 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:32:45 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:32:45 user nova-compute[74295]:   <metadata>
Oct 26 06:32:45 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:32:45 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:32:45 user nova-compute[74295]:       <nova:name>tempest-ServerActionsTestOtherA-server-1405397235</nova:name>
Oct 26 06:32:45 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:32:43</nova:creationTime>
Oct 26 06:32:45 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:32:45 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:32:45 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:32:45 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:32:45 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:32:45 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:32:45 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:32:45 user nova-compute[74295]:       <nova:owner>
Oct 26 06:32:45 user nova-compute[74295]:         <nova:user uuid="e3c3d6fa25d143bc935e7e16275aac57">tempest-ServerActionsTestOtherA-911482981-project-member</nova:user>
Oct 26 06:32:45 user nova-compute[74295]:         <nova:project uuid="83b6035868e347c4b90651f3ad73237a">tempest-ServerActionsTestOtherA-911482981</nova:project>
Oct 26 06:32:45 user nova-compute[74295]:       </nova:owner>
Oct 26 06:32:45 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:32:45 user nova-compute[74295]:       <nova:ports>
Oct 26 06:32:45 user nova-compute[74295]:         <nova:port uuid="2b5d323f-8884-4acb-a176-40dfcf957402">
Oct 26 06:32:45 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:32:45 user nova-compute[74295]:         </nova:port>
Oct 26 06:32:45 user nova-compute[74295]:       </nova:ports>
Oct 26 06:32:45 user nova-compute[74295]:     </nova:instance>
Oct 26 06:32:45 user nova-compute[74295]:   </metadata>
Oct 26 06:32:45 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:32:45 user nova-compute[74295]:     <system>
Oct 26 06:32:45 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:32:45 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:32:45 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:32:45 user nova-compute[74295]:       <entry name="serial">cf010631-119f-42b0-a356-a645b27e4081</entry>
Oct 26 06:32:45 user nova-compute[74295]:       <entry name="uuid">cf010631-119f-42b0-a356-a645b27e4081</entry>
Oct 26 06:32:45 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:32:45 user nova-compute[74295]:     </system>
Oct 26 06:32:45 user nova-compute[74295]:   </sysinfo>
Oct 26 06:32:45 user nova-compute[74295]:   <os>
Oct 26 06:32:45 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:32:45 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:32:45 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:32:45 user nova-compute[74295]:   </os>
Oct 26 06:32:45 user nova-compute[74295]:   <features>
Oct 26 06:32:45 user nova-compute[74295]:     <acpi/>
Oct 26 06:32:45 user nova-compute[74295]:     <apic/>
Oct 26 06:32:45 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:32:45 user nova-compute[74295]:   </features>
Oct 26 06:32:45 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:32:45 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:32:45 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:32:45 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:32:45 user nova-compute[74295]:   </clock>
Oct 26 06:32:45 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:32:45 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:32:45 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:32:45 user nova-compute[74295]:   </cpu>
Oct 26 06:32:45 user nova-compute[74295]:   <devices>
Oct 26 06:32:45 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:32:45 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:32:45 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk"/>
Oct 26 06:32:45 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:32:45 user nova-compute[74295]:     </disk>
Oct 26 06:32:45 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:32:45 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:32:45 user nova-compute[74295]:       <source dev="/dev/sde"/>
Oct 26 06:32:45 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:32:45 user nova-compute[74295]:       <serial>f4d75b2c-b5c2-46ca-b024-e65d7fd922bd</serial>
Oct 26 06:32:45 user nova-compute[74295]:     </disk>
Oct 26 06:32:45 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:32:45 user nova-compute[74295]:       <mac address="fa:16:3e:59:49:33"/>
Oct 26 06:32:45 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:32:45 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:32:45 user nova-compute[74295]:       <target dev="tap2b5d323f-88"/>
Oct 26 06:32:45 user nova-compute[74295]:     </interface>
Oct 26 06:32:45 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:32:45 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/console.log" append="off"/>
Oct 26 06:32:45 user nova-compute[74295]:     </serial>
Oct 26 06:32:45 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:32:45 user nova-compute[74295]:     <video>
Oct 26 06:32:45 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:32:45 user nova-compute[74295]:     </video>
Oct 26 06:32:45 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:32:45 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:32:45 user nova-compute[74295]:     </rng>
Oct 26 06:32:45 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:32:45 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:32:45 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:32:45 user nova-compute[74295]:     </memballoon>
Oct 26 06:32:45 user nova-compute[74295]:   </devices>
Oct 26 06:32:45 user nova-compute[74295]: </domain>
Oct 26 06:32:45 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-213606875',display_name='tempest-ServerActionsTestOtherA-server-1405397235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-213606875',id=14,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtH+FO/rcPVmXXNwudgrvBLEMmMcqmnAHUrdcVJlWtaZpsycsfMyvP1tJmmBYEi4UMNSFlb3baPyXSYG4kOajpOED31FcaPy44SBBtSx6sYgvc6+6JiuCiXwwpnNliueA==',key_name='tempest-keypair-1139203649',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-k4edxa0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=cf010631-119f-42b0-a356-a645b27e4081,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG os_vif [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14314c68-91a8-5f25-a22a-def5af88d926', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b5d323f-88, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b5d323f-88, col_values=(('qos', UUID('5438dc1d-9956-46c0-a0b0-9029977c4a09')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b5d323f-88, col_values=(('external_ids', {'iface-id': '2b5d323f-8884-4acb-a176-40dfcf957402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:49:33', 'vm-uuid': 'cf010631-119f-42b0-a356-a645b27e4081'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:45 user nova-compute[74295]: INFO os_vif [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88')
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No VIF found with MAC fa:16:3e:59:49:33, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:32:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:47 user nova-compute[74295]: INFO nova.compute.manager [None req-25bda5de-e8a5-4ac9-bfe3-49130a1b0da4 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Unrescuing
Oct 26 06:32:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-25bda5de-e8a5-4ac9-bfe3-49130a1b0da4 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:32:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-25bda5de-e8a5-4ac9-bfe3-49130a1b0da4 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquired lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:32:47 user nova-compute[74295]: DEBUG nova.network.neutron [None req-25bda5de-e8a5-4ac9-bfe3-49130a1b0da4 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG nova.network.neutron [None req-25bda5de-e8a5-4ac9-bfe3-49130a1b0da4 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updating instance_info_cache with network_info: [{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-25bda5de-e8a5-4ac9-bfe3-49130a1b0da4 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Releasing lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG nova.objects.instance [None req-25bda5de-e8a5-4ac9-bfe3-49130a1b0da4 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'flavor' on Instance uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFIPdrGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:32:48 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:48 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:32:48 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e38f3b-be7e-4a7c-8382-7471e42f8947]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:32:48 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e796ef9-5108-4b87-8b8d-f05bbb6ba59b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298] added
Oct 26 06:32:48 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6e9be1-e385-4750-ac98-8e8abc4149a0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2484d4ae-d303-4fba-a501-60969f0eddba]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xFIPdrGm {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xFIPdrGm" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c7f37d-0269-49d4-930d-54fb5121c26f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xFIPdrGm'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8deb86-827f-4032-bb3f-21cae66ccede]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[76edf45a-0d36-41a8-8686-f644c7c730fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:48 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:48 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-50223f04-ad13-48b8-bb40-73b7d177ee3e req-f1499e3f-bb76-4ba5-b8da-ad6090433423 service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-50223f04-ad13-48b8-bb40-73b7d177ee3e req-f1499e3f-bb76-4ba5-b8da-ad6090433423 service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-50223f04-ad13-48b8-bb40-73b7d177ee3e req-f1499e3f-bb76-4ba5-b8da-ad6090433423 service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-50223f04-ad13-48b8-bb40-73b7d177ee3e req-f1499e3f-bb76-4ba5-b8da-ad6090433423 service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-50223f04-ad13-48b8-bb40-73b7d177ee3e req-f1499e3f-bb76-4ba5-b8da-ad6090433423 service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:48 user nova-compute[74295]: WARNING nova.compute.manager [req-50223f04-ad13-48b8-bb40-73b7d177ee3e req-f1499e3f-bb76-4ba5-b8da-ad6090433423 service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[546e15a1-e507-49ef-9eac-ed77255006db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298, portal: 172.16.0.220,3260]
Oct 26 06:32:48 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298, portal: 172.16.0.220,3260] successful.
Oct 26 06:32:48 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7137e0-e46c-4e55-ba43-cfb5e06849c5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[881859da-eac5-436c-94b3-4f72d44879a7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:32:48 user nova-compute[74295]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 (non-flash)
Oct 26 06:32:48 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0d709-ba9d-4360-8cab-05b2fed626e5]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:32:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFIPdrGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Instance destroyed successfully.
Oct 26 06:32:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:32:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cf010631-119f-42b0-a356-a645b27e4081] Instance spawned successfully.
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.objects.instance [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74295) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23836646135323431', 'path': '/dev/sdf'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836646135323431', 'path': '/dev/sdf'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lazy-loading 'flavor' on Instance uuid 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61399e0f-0e4f-4cf9-8275-d67142fe675b tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.138s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:32:49 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:32:49 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:32:49 user nova-compute[74295]:   <target dev="vdc" bus="virtio"/>
Oct 26 06:32:49 user nova-compute[74295]:   <serial>2c5eb421-01be-4b09-8a4d-0a67a21a3298</serial>
Oct 26 06:32:49 user nova-compute[74295]: </disk>
Oct 26 06:32:49 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-8a2a6a2b-0a83-408f-aefa-f57e759a31ed req-0da80b28-fd62-4755-80bd-2d3f434e2c17 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8a2a6a2b-0a83-408f-aefa-f57e759a31ed req-0da80b28-fd62-4755-80bd-2d3f434e2c17 service nova] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8a2a6a2b-0a83-408f-aefa-f57e759a31ed req-0da80b28-fd62-4755-80bd-2d3f434e2c17 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8a2a6a2b-0a83-408f-aefa-f57e759a31ed req-0da80b28-fd62-4755-80bd-2d3f434e2c17 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-8a2a6a2b-0a83-408f-aefa-f57e759a31ed req-0da80b28-fd62-4755-80bd-2d3f434e2c17 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] No waiting events found dispatching network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:50 user nova-compute[74295]: WARNING nova.compute.manager [req-8a2a6a2b-0a83-408f-aefa-f57e759a31ed req-0da80b28-fd62-4755-80bd-2d3f434e2c17 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received unexpected event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 for instance with vm_state active and task_state None.
Oct 26 06:32:50 user nova-compute[74295]: INFO nova.compute.manager [None req-82823191-c253-4eb1-bd03-517f9d8fbe9c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Unrescuing
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-82823191-c253-4eb1-bd03-517f9d8fbe9c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-82823191-c253-4eb1-bd03-517f9d8fbe9c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquired lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-82823191-c253-4eb1-bd03-517f9d8fbe9c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:50 user nova-compute[74295]: WARNING nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:50 user nova-compute[74295]: WARNING nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:50 user nova-compute[74295]: WARNING nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:50 user nova-compute[74295]: WARNING nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:50 user nova-compute[74295]: WARNING nova.compute.manager [req-1d1502ec-f073-4b94-866f-bc4be157f97c req-84f3a3bc-4c3c-450d-8fc2-d7883fb298bb service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-82823191-c253-4eb1-bd03-517f9d8fbe9c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updating instance_info_cache with network_info: [{"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-82823191-c253-4eb1-bd03-517f9d8fbe9c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Releasing lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG nova.objects.instance [None req-82823191-c253-4eb1-bd03-517f9d8fbe9c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'flavor' on Instance uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] No VIF found with MAC fa:16:3e:0d:eb:54, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6bdb7096-bc75-4b92-a4c4-a79aae3da8b5 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.058s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:52 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Instance destroyed successfully.
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] No waiting events found dispatching network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:52 user nova-compute[74295]: WARNING nova.compute.manager [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received unexpected event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 for instance with vm_state active and task_state None.
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-unplugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-unplugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:52 user nova-compute[74295]: WARNING nova.compute.manager [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-unplugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:52 user nova-compute[74295]: WARNING nova.compute.manager [req-fe8424f9-d1ab-44ad-a75c-60d54469cf58 req-0ac31727-cea3-492d-96c4-47a65d8408b6 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:52 user nova-compute[74295]: INFO nova.compute.manager [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Detaching volume 2c5eb421-01be-4b09-8a4d-0a67a21a3298
Oct 26 06:32:52 user nova-compute[74295]: INFO nova.virt.block_device [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Attempting to driver detach volume 2c5eb421-01be-4b09-8a4d-0a67a21a3298 from mountpoint /dev/vdc
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Attempting to detach device vdc from instance 1229385f-194e-482e-ac54-ca9cc2591edd from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:32:52 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:32:52 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:32:52 user nova-compute[74295]:   <target dev="vdc" bus="virtio"/>
Oct 26 06:32:52 user nova-compute[74295]:   <serial>2c5eb421-01be-4b09-8a4d-0a67a21a3298</serial>
Oct 26 06:32:52 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 06:32:52 user nova-compute[74295]: </disk>
Oct 26 06:32:52 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:32:52 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Successfully detached device vdc from instance 1229385f-194e-482e-ac54-ca9cc2591edd from the persistent domain config.
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1229385f-194e-482e-ac54-ca9cc2591edd from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:32:52 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:32:52 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:32:52 user nova-compute[74295]:   <target dev="vdc" bus="virtio"/>
Oct 26 06:32:52 user nova-compute[74295]:   <serial>2c5eb421-01be-4b09-8a4d-0a67a21a3298</serial>
Oct 26 06:32:52 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 06:32:52 user nova-compute[74295]: </disk>
Oct 26 06:32:52 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:52 user nova-compute[74295]: WARNING nova.compute.manager [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.017s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:52 user nova-compute[74295]: WARNING nova.compute.manager [req-01ca413d-2a55-4c65-8593-87ecc5ab1e5f req-99e6383e-77de-4352-a5f6-c432ab34142e service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:32:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b58e98a-4168-4c48-bc2d-5b5390294434 req-a17bf94d-83a1-41bc-a418-a6959dbe0066 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b58e98a-4168-4c48-bc2d-5b5390294434 req-a17bf94d-83a1-41bc-a418-a6959dbe0066 service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b58e98a-4168-4c48-bc2d-5b5390294434 req-a17bf94d-83a1-41bc-a418-a6959dbe0066 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b58e98a-4168-4c48-bc2d-5b5390294434 req-a17bf94d-83a1-41bc-a418-a6959dbe0066 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b58e98a-4168-4c48-bc2d-5b5390294434 req-a17bf94d-83a1-41bc-a418-a6959dbe0066 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:54 user nova-compute[74295]: WARNING nova.compute.manager [req-9b58e98a-4168-4c48-bc2d-5b5390294434 req-a17bf94d-83a1-41bc-a418-a6959dbe0066 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_power_states {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid c002695d-145c-4e74-90ae-aa1133680472 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 775d5e2e-95a6-4a86-b6f3-ce96735378d9 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid b1d6362b-2ffb-4574-8f19-48855f6e7869 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 88335730-9d04-4614-8c24-f0c3957418f2 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid b1f13ee5-22e7-466c-a117-ae4a707ad2bc {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 0440536c-c9ad-439e-aa26-689b945c63ea {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid d98449c4-fbe5-44cc-82d4-d5d88b28c68d {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid cf010631-119f-42b0-a356-a645b27e4081 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "c002695d-145c-4e74-90ae-aa1133680472" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: INFO nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] During sync_power_state the instance has a pending task (unrescuing). Skip.
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "88335730-9d04-4614-8c24-f0c3957418f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: INFO nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] During sync_power_state the instance has a pending task (unrescuing). Skip.
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "0440536c-c9ad-439e-aa26-689b945c63ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "0440536c-c9ad-439e-aa26-689b945c63ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "cf010631-119f-42b0-a356-a645b27e4081" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "c002695d-145c-4e74-90ae-aa1133680472" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "0440536c-c9ad-439e-aa26-689b945c63ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.158s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "cf010631-119f-42b0-a356-a645b27e4081" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.178s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.189s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "88335730-9d04-4614-8c24-f0c3957418f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.192s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-0022a553-89a3-4dc6-9bfc-633fe509a9c4 req-85cfd19d-ccc4-463b-be45-6434fbd37631 service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received event network-changed-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-0022a553-89a3-4dc6-9bfc-633fe509a9c4 req-85cfd19d-ccc4-463b-be45-6434fbd37631 service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Refreshing instance network info cache due to event network-changed-3a25550b-3555-4da8-81b1-8510844fc8ec. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0022a553-89a3-4dc6-9bfc-633fe509a9c4 req-85cfd19d-ccc4-463b-be45-6434fbd37631 service nova] Acquiring lock "refresh_cache-b1f13ee5-22e7-466c-a117-ae4a707ad2bc" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0022a553-89a3-4dc6-9bfc-633fe509a9c4 req-85cfd19d-ccc4-463b-be45-6434fbd37631 service nova] Acquired lock "refresh_cache-b1f13ee5-22e7-466c-a117-ae4a707ad2bc" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-0022a553-89a3-4dc6-9bfc-633fe509a9c4 req-85cfd19d-ccc4-463b-be45-6434fbd37631 service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Refreshing network info cache for port 3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-25bda5de-e8a5-4ac9-bfe3-49130a1b0da4 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.objects.instance [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lazy-loading 'flavor' on Instance uuid b1f13ee5-22e7-466c-a117-ae4a707ad2bc {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-0022a553-89a3-4dc6-9bfc-633fe509a9c4 req-85cfd19d-ccc4-463b-be45-6434fbd37631 service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Updated VIF entry in instance network info cache for port 3a25550b-3555-4da8-81b1-8510844fc8ec. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-0022a553-89a3-4dc6-9bfc-633fe509a9c4 req-85cfd19d-ccc4-463b-be45-6434fbd37631 service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Updating instance_info_cache with network_info: [{"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:32:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0022a553-89a3-4dc6-9bfc-633fe509a9c4 req-85cfd19d-ccc4-463b-be45-6434fbd37631 service nova] Releasing lock "refresh_cache-b1f13ee5-22e7-466c-a117-ae4a707ad2bc" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:56 user nova-compute[74295]: INFO nova.compute.manager [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Attaching volume 71a685cc-8c7f-4a69-8093-282313bfb0f4 to /dev/vdb
Oct 26 06:32:56 user nova-compute[74295]: DEBUG os_brick.utils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f3a08d-28aa-4ee7-ae12-4eac28d44494]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b80cc48-f3d9-4a21-abf3-faf8a7d65ba0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb09c77f-3201-4e32-b0d3-13ff34b777ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6c9f78-cdc9-4d02-b743-09d910b00486]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:32:56 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30e1989-9b53-4489-960c-4a7563d68bc6]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG os_brick.utils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Updating existing volume attachment record: b1776c6e-2727-4878-ac42-f926b99bf2b3 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-bd2535ef-2ab9-44cc-9a8a-59b17ebf5027 req-bc92e5f0-1648-4443-84f6-c6857e1d9230 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bd2535ef-2ab9-44cc-9a8a-59b17ebf5027 req-bc92e5f0-1648-4443-84f6-c6857e1d9230 service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bd2535ef-2ab9-44cc-9a8a-59b17ebf5027 req-bc92e5f0-1648-4443-84f6-c6857e1d9230 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bd2535ef-2ab9-44cc-9a8a-59b17ebf5027 req-bc92e5f0-1648-4443-84f6-c6857e1d9230 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-bd2535ef-2ab9-44cc-9a8a-59b17ebf5027 req-bc92e5f0-1648-4443-84f6-c6857e1d9230 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:32:56 user nova-compute[74295]: WARNING nova.compute.manager [req-bd2535ef-2ab9-44cc-9a8a-59b17ebf5027 req-bc92e5f0-1648-4443-84f6-c6857e1d9230 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:32:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:32:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-82823191-c253-4eb1-bd03-517f9d8fbe9c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:32:59 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:33:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:01 user nova-compute[74295]: INFO nova.compute.manager [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Terminating instance
Oct 26 06:33:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-6f0868e4-747c-4cf8-89f9-6844dd6dbb16 req-d1a454ee-d878-4490-ba40-1413acceb2df service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received event network-vif-unplugged-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6f0868e4-747c-4cf8-89f9-6844dd6dbb16 req-d1a454ee-d878-4490-ba40-1413acceb2df service nova] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6f0868e4-747c-4cf8-89f9-6844dd6dbb16 req-d1a454ee-d878-4490-ba40-1413acceb2df service nova] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6f0868e4-747c-4cf8-89f9-6844dd6dbb16 req-d1a454ee-d878-4490-ba40-1413acceb2df service nova] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-6f0868e4-747c-4cf8-89f9-6844dd6dbb16 req-d1a454ee-d878-4490-ba40-1413acceb2df service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] No waiting events found dispatching network-vif-unplugged-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-6f0868e4-747c-4cf8-89f9-6844dd6dbb16 req-d1a454ee-d878-4490-ba40-1413acceb2df service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received event network-vif-unplugged-860eca16-317b-46e1-aa65-716d66e7b7ca for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Instance destroyed successfully.
Oct 26 06:33:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lazy-loading 'resources' on Instance uuid 88335730-9d04-4614-8c24-f0c3957418f2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1178213190',display_name='tempest-VolumesAdminNegativeTest-server-1178213190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1178213190',id=8,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDigW1iO7v8D/3Y78VhHUPq4WOhWQBt5JTPhjsnwB8miq8nWuxh/eaxy6tWPoS92DhVjAVpbaWJrBFUYNUCjtvVmShsMij7YX6gknbT0bdGnHHPsWw8iqDQVkXxJJhKE7Q==',key_name='tempest-keypair-1217667034',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14561432954b4ce78599f0bd131a1863',ramdisk_id='',reservation_id='r-nml640zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-417079322',owner_user_name='tempest-VolumesAdminNegativeTest-417079322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4691863b37da4920a7d50434b9f4584c',uuid=88335730-9d04-4614-8c24-f0c3957418f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converting VIF {"id": "860eca16-317b-46e1-aa65-716d66e7b7ca", "address": "fa:16:3e:f0:ae:bc", "network": {"id": "d07c6e55-548b-46e9-9825-38e38f7dba45", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1688528566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14561432954b4ce78599f0bd131a1863", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap860eca16-31", "ovs_interfaceid": "860eca16-317b-46e1-aa65-716d66e7b7ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:ae:bc,bridge_name='br-int',has_traffic_filtering=True,id=860eca16-317b-46e1-aa65-716d66e7b7ca,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860eca16-31') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG os_vif [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:ae:bc,bridge_name='br-int',has_traffic_filtering=True,id=860eca16-317b-46e1-aa65-716d66e7b7ca,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860eca16-31') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap860eca16-31, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=503f45a0-ad3b-491d-968f-413bc26444c7) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:01 user nova-compute[74295]: INFO os_vif [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:ae:bc,bridge_name='br-int',has_traffic_filtering=True,id=860eca16-317b-46e1-aa65-716d66e7b7ca,network=Network(d07c6e55-548b-46e9-9825-38e38f7dba45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap860eca16-31')
Oct 26 06:33:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Deleting instance files /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2_del
Oct 26 06:33:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Deletion of /opt/stack/data/nova/instances/88335730-9d04-4614-8c24-f0c3957418f2_del complete
Oct 26 06:33:02 user nova-compute[74295]: INFO nova.compute.manager [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 26 06:33:02 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:33:02 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:33:02 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-affe36ea-6624-4ffb-b702-9bb19e43264f req-25cfc08f-f1e0-4678-a2df-b96ad7851c4c service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received event network-vif-deleted-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:03 user nova-compute[74295]: INFO nova.compute.manager [req-affe36ea-6624-4ffb-b702-9bb19e43264f req-25cfc08f-f1e0-4678-a2df-b96ad7851c4c service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Neutron deleted interface 860eca16-317b-46e1-aa65-716d66e7b7ca; detaching it from the instance and deleting it from the info cache
Oct 26 06:33:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-affe36ea-6624-4ffb-b702-9bb19e43264f req-25cfc08f-f1e0-4678-a2df-b96ad7851c4c service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:33:03 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Took 1.33 seconds to deallocate network for instance.
Oct 26 06:33:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-affe36ea-6624-4ffb-b702-9bb19e43264f req-25cfc08f-f1e0-4678-a2df-b96ad7851c4c service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Detach interface failed, port_id=860eca16-317b-46e1-aa65-716d66e7b7ca, reason: Instance 88335730-9d04-4614-8c24-f0c3957418f2 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "6b441689-7c38-455d-a55e-6cd9615049cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-5a6ec7c6-b06c-42a4-b887-e2ccfa9bd42f req-0a419da2-1d7b-4ba5-a5ce-82e632812994 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received event network-vif-plugged-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5a6ec7c6-b06c-42a4-b887-e2ccfa9bd42f req-0a419da2-1d7b-4ba5-a5ce-82e632812994 service nova] Acquiring lock "88335730-9d04-4614-8c24-f0c3957418f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5a6ec7c6-b06c-42a4-b887-e2ccfa9bd42f req-0a419da2-1d7b-4ba5-a5ce-82e632812994 service nova] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5a6ec7c6-b06c-42a4-b887-e2ccfa9bd42f req-0a419da2-1d7b-4ba5-a5ce-82e632812994 service nova] Lock "88335730-9d04-4614-8c24-f0c3957418f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-5a6ec7c6-b06c-42a4-b887-e2ccfa9bd42f req-0a419da2-1d7b-4ba5-a5ce-82e632812994 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] No waiting events found dispatching network-vif-plugged-860eca16-317b-46e1-aa65-716d66e7b7ca {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:03 user nova-compute[74295]: WARNING nova.compute.manager [req-5a6ec7c6-b06c-42a4-b887-e2ccfa9bd42f req-0a419da2-1d7b-4ba5-a5ce-82e632812994 service nova] [instance: 88335730-9d04-4614-8c24-f0c3957418f2] Received unexpected event network-vif-plugged-860eca16-317b-46e1-aa65-716d66e7b7ca for instance with vm_state deleted and task_state None.
Oct 26 06:33:03 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:33:03 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.338s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:33:04 user nova-compute[74295]: INFO nova.compute.claims [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Claim successful on node user
Oct 26 06:33:04 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Deleted allocations for instance 88335730-9d04-4614-8c24-f0c3957418f2
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c19e5e7-b4bb-423c-9d4c-e4ecd697d382 tempest-VolumesAdminNegativeTest-417079322 tempest-VolumesAdminNegativeTest-417079322-project-member] Lock "88335730-9d04-4614-8c24-f0c3957418f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.078s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:33:04 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:33:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG nova.policy [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '463ace29d09f4b9d9460901159b82aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ec6997c8d74b10901d0d1edca094c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:33:04 user nova-compute[74295]: INFO nova.virt.block_device [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Booting with volume f879a984-b889-46ee-9eeb-db8d85769e7f at /dev/vda
Oct 26 06:33:04 user nova-compute[74295]: DEBUG os_brick.utils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fb7576-a8b7-4e7d-915a-c7d2c33b0787]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ddb25f-4019-47d9-b314-75ba8681a3f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[725ea98a-3cd6-41b6-a945-1a9b6a49247a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5026e7c0-d685-4bbc-939a-2c436888c593]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:33:04 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:33:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4601c8-9482-4bb7-a418-130b51fb0ae9]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:33:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:33:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:33:05 user nova-compute[74295]: DEBUG os_brick.utils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:05 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Updating existing volume attachment record: 53da720e-3087-439f-a652-40edf0eab1e4 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:33:05 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:33:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:33:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Successfully created port: 16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Successfully updated port: 16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "refresh_cache-6b441689-7c38-455d-a55e-6cd9615049cf" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquired lock "refresh_cache-6b441689-7c38-455d-a55e-6cd9615049cf" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-75f88a30-ebf6-4b0e-882b-6c44f4230e63 req-2c3c9e88-ad54-4021-a416-641f1373e65b service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-changed-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-75f88a30-ebf6-4b0e-882b-6c44f4230e63 req-2c3c9e88-ad54-4021-a416-641f1373e65b service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Refreshing instance network info cache due to event network-changed-16d2b3ee-0200-4890-918e-3caddf53dcaa. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-75f88a30-ebf6-4b0e-882b-6c44f4230e63 req-2c3c9e88-ad54-4021-a416-641f1373e65b service nova] Acquiring lock "refresh_cache-6b441689-7c38-455d-a55e-6cd9615049cf" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Updating instance_info_cache with network_info: [{"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Releasing lock "refresh_cache-6b441689-7c38-455d-a55e-6cd9615049cf" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance network_info: |[{"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-75f88a30-ebf6-4b0e-882b-6c44f4230e63 req-2c3c9e88-ad54-4021-a416-641f1373e65b service nova] Acquired lock "refresh_cache-6b441689-7c38-455d-a55e-6cd9615049cf" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-75f88a30-ebf6-4b0e-882b-6c44f4230e63 req-2c3c9e88-ad54-4021-a416-641f1373e65b service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Refreshing network info cache for port 16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-75f88a30-ebf6-4b0e-882b-6c44f4230e63 req-2c3c9e88-ad54-4021-a416-641f1373e65b service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Updated VIF entry in instance network info cache for port 16d2b3ee-0200-4890-918e-3caddf53dcaa. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-75f88a30-ebf6-4b0e-882b-6c44f4230e63 req-2c3c9e88-ad54-4021-a416-641f1373e65b service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Updating instance_info_cache with network_info: [{"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-75f88a30-ebf6-4b0e-882b-6c44f4230e63 req-2c3c9e88-ad54-4021-a416-641f1373e65b service nova] Releasing lock "refresh_cache-6b441689-7c38-455d-a55e-6cd9615049cf" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:33:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.467s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Port f0e3fe7f-b73a-48b6-bc9d-adac272022b4 binding to destination host user is already ACTIVE {{(pid=74295) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquired lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG nova.network.neutron [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance_info_cache with network_info: [{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Releasing lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Creating tmpfile /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/tmph6wqxl61 to verify with other compute node that the instance is on the same shared storage. {{(pid=74295) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-586d293c-ff85-43e3-b3f8-8d1e90859a7a req-d55d113a-abef-4bf8-9b6b-603fe618c714 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-unplugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-586d293c-ff85-43e3-b3f8-8d1e90859a7a req-d55d113a-abef-4bf8-9b6b-603fe618c714 service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-586d293c-ff85-43e3-b3f8-8d1e90859a7a req-d55d113a-abef-4bf8-9b6b-603fe618c714 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-586d293c-ff85-43e3-b3f8-8d1e90859a7a req-d55d113a-abef-4bf8-9b6b-603fe618c714 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-586d293c-ff85-43e3-b3f8-8d1e90859a7a req-d55d113a-abef-4bf8-9b6b-603fe618c714 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-unplugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:09 user nova-compute[74295]: WARNING nova.compute.manager [req-586d293c-ff85-43e3-b3f8-8d1e90859a7a req-d55d113a-abef-4bf8-9b6b-603fe618c714 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-unplugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state resized and task_state resize_reverting.
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance destroyed successfully.
Oct 26 06:33:10 user nova-compute[74295]: DEBUG nova.objects.instance [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lazy-loading 'resources' on Instance uuid 775d5e2e-95a6-4a86-b6f3-ce96735378d9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-97936637',display_name='tempest-ServerActionsTestOtherB-server-97936637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-97936637',id=4,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmm1IaoBoVd8Hkv3gtx/L78lFPzYOW0A2Qqc9FfseOv4MiM64O4tVX1rCM39AF+LH46KHkGVTicvdWviQLc+ppyTXiLGRvBGUpaFnTBwUaROd5zinEiEdd3gXRLbgwTBg==',key_name='tempest-keypair-393220372',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:31:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd8a2b9f8cce49d4985549fd42dc1e8a',ramdisk_id='',reservation_id='r-cmxn1myp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-406693711',owner_user_name='tempest-ServerActionsTestOtherB-406693711-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e44a6886b2b478dbca031edd15a9a6f',uuid=775d5e2e-95a6-4a86-b6f3-ce96735378d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converting VIF {"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_vif [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0e3fe7f-b7, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85e7bb0d-cbef-4800-b004-43669d2b98c4) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:33:10 user nova-compute[74295]: INFO os_vif [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7')
Oct 26 06:33:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:10 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5054d830-d1fe-4a0d-aadf-e3a1dad0d0b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:33:10 user nova-compute[74295]: No targets found.
Oct 26 06:33:10 user nova-compute[74295]: iSNS:
Oct 26 06:33:10 user nova-compute[74295]: No targets found.
Oct 26 06:33:10 user nova-compute[74295]: STATIC:
Oct 26 06:33:10 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:33:10 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:10 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:10 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5
Oct 26 06:33:10 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:10 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:10 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:33:10 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:10 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:10 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298
Oct 26 06:33:10 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:10 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:10 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:33:10 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:10 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:10 user nova-compute[74295]: FIRMWARE:
Oct 26 06:33:10 user nova-compute[74295]: No targets found.
Oct 26 06:33:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:33:10 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:33:10 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b0f4f4-b46f-47a4-aad5-ac027fe6404f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6628ff-2917-4297-9804-7fd4f33ad0b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:10 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:10 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:10 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:10 user nova-compute[74295]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 (non-flash)
Oct 26 06:33:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:10 user nova-compute[74295]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:10 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:10 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:10 user nova-compute[74295]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 (non-flash)
Oct 26 06:33:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1bfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee6a2a1-5417-4134-94ce-6901641df147]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e3b9fe-4da0-4b26-9278-2ef80833a2e7]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0aff187-0ece-4331-a866-10e569189a0e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ccfcd5-ac8d-4866-9e68-7c7015afa22c]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[92472e83-ccd7-4f6f-b3f0-fe32604f2a06]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f01f82a-b63a-4f79-b9ca-4577ca5957ff]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]
Oct 26 06:33:10 user nova-compute[74295]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.
Oct 26 06:33:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8042a09-eb7d-4ebe-b9ce-38c089aa71cb]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] <== disconnect_volume: return (432ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-363bf98f-1289-4357-8f98-0a594b04eb53 req-26818ad9-27be-46db-936f-574d74bb39ef service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-363bf98f-1289-4357-8f98-0a594b04eb53 req-26818ad9-27be-46db-936f-574d74bb39ef service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-363bf98f-1289-4357-8f98-0a594b04eb53 req-26818ad9-27be-46db-936f-574d74bb39ef service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-363bf98f-1289-4357-8f98-0a594b04eb53 req-26818ad9-27be-46db-936f-574d74bb39ef service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-363bf98f-1289-4357-8f98-0a594b04eb53 req-26818ad9-27be-46db-936f-574d74bb39ef service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:11 user nova-compute[74295]: WARNING nova.compute.manager [req-363bf98f-1289-4357-8f98-0a594b04eb53 req-26818ad9-27be-46db-936f-574d74bb39ef service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state resized and task_state resize_reverting.
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG nova.objects.instance [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lazy-loading 'migration_context' on Instance uuid 775d5e2e-95a6-4a86-b6f3-ce96735378d9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG nova.objects.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Object Instance<775d5e2e-95a6-4a86-b6f3-ce96735378d9> lazy-loaded attributes: resources,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.774s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:12 user nova-compute[74295]: INFO nova.compute.manager [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Swapping old allocation on dict_keys(['83a4b092-caa9-49fc-b639-9b9bc5d3ce84']) held by migration 288bbde7-fba4-4018-867d-86cae276705e for instance
Oct 26 06:33:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Overwriting current allocation {'allocations': {'83a4b092-caa9-49fc-b639-9b9bc5d3ce84': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': 'dd8a2b9f8cce49d4985549fd42dc1e8a', 'user_id': '8e44a6886b2b478dbca031edd15a9a6f', 'consumer_generation': 1} on consumer 775d5e2e-95a6-4a86-b6f3-ce96735378d9 {{(pid=74295) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 26 06:33:13 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:33:13 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7303MB free_disk=25.290977478027344GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cf010631-119f-42b0-a356-a645b27e4081 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1229385f-194e-482e-ac54-ca9cc2591edd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1f13ee5-22e7-466c-a117-ae4a707ad2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 0440536c-c9ad-439e-aa26-689b945c63ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 6b441689-7c38-455d-a55e-6cd9615049cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquired lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance_info_cache with network_info: [{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Releasing lock "refresh_cache-775d5e2e-95a6-4a86-b6f3-ce96735378d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG os_brick.utils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:13 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1229385f-194e-482e-ac54-ca9cc2591edd is timed out.
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f56c9-fcd3-40a5-830a-a2aa29663b47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Successfully detached device vdc from instance 1229385f-194e-482e-ac54-ca9cc2591edd from the live domain config.
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xFIPdrGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:13 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[65db5ada-58d6-4094-88de-b2ed5a98b119]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead160f6-e7a6-44f2-bf9d-213bf120850b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:33:13 user nova-compute[74295]: No targets found.
Oct 26 06:33:13 user nova-compute[74295]: iSNS:
Oct 26 06:33:13 user nova-compute[74295]: No targets found.
Oct 26 06:33:13 user nova-compute[74295]: STATIC:
Oct 26 06:33:13 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5
Oct 26 06:33:13 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:13 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:13 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:33:13 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:13 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:13 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298
Oct 26 06:33:13 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:13 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:13 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:33:13 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:13 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:13 user nova-compute[74295]: FIRMWARE:
Oct 26 06:33:13 user nova-compute[74295]: No targets found.
Oct 26 06:33:13 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:33:13 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:33:13 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce92eb07-4be9-405e-adf1-8a61050fcb75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f00ca7-904b-4ab5-b76e-22579cea5e75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff321cb1-d4e2-4768-8111-af8cfdf027d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:33:14 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e096b4cb-936a-4d02-b667-7e9a091bfb52]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.utils [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[49883443-76e6-499c-a07d-02c6cf9d615a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:14 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:14 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:14 user nova-compute[74295]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 (non-flash)
Oct 26 06:33:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:14 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:14 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:14 user nova-compute[74295]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 (non-flash)
Oct 26 06:33:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1b9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298'): ({'sdf'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Removing single pathed devices sdf {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[794eb6e7-6a2f-4111-9300-3466ed5da24d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed780c58-cb50-42b3-9e7b-44bc91726618]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Flushing IO for device /dev/sdf {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[09933611-4f6a-4a06-a2a6-1039d511065e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd8b416-b355-46d3-9935-54c48e20b3ad]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3abb5d-36c4-4c74-ad53-d5611158bd08]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c53407-6325-4026-83c8-b9a1f41aa00d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298, portal: 172.16.0.220,3260]
Oct 26 06:33:14 user nova-compute[74295]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298, portal: 172.16.0.220,3260] successful.
Oct 26 06:33:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5eb421-01be-4b09-8a4d-0a67a21a3298 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[578af809-e7dc-4fe1-9be7-b7cc4a84879f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] <== disconnect_volume: return (373ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:33:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:33:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:33:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:33:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVCyRArE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:17 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:17 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:17 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[faee8cb4-cd01-458b-b3ab-4c9b4195a93a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:33:17 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf61d2e-417a-4d86-af8f-7ff102969caf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4] added
Oct 26 06:33:17 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3953ff9-b418-4c79-9cf9-e16cb78bc6f0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bf0de5-a38f-413f-bf0a-22531983417e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVCyRArE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVCyRArE" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d52136c-a15e-4adc-a9ad-82de30845a27]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVCyRArE'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4972306-44f0-4128-88d8-e68e63b933ce]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9924fd36-aee3-412c-b8d3-c08324cf3173]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:17 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:17 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:17 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:17 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:17 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:17 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac402264-e998-4fe7-b67e-eac10fd22432]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4, portal: 172.16.0.220,3260]
Oct 26 06:33:17 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4, portal: 172.16.0.220,3260] successful.
Oct 26 06:33:17 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cf7035-c7c9-4dc9-9a40-0da5c0f8c5be]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61ccc0f-8e59-4812-89b0-222749ac98e2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:18 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:18 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:18 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:18 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:18 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:18 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:18 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:18 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8140cc45-5c81-4a5b-b8cb-e09778fa23b9]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVCyRArE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG nova.objects.instance [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lazy-loading 'flavor' on Instance uuid 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-8595e73d-f054-41d0-8344-049709fb7d50 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.066s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 23.637s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26665616563663939', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665616563663939', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:33:19 user nova-compute[74295]: DEBUG nova.objects.instance [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lazy-loading 'flavor' on Instance uuid b1f13ee5-22e7-466c-a117-ae4a707ad2bc {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:33:19 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:33:19 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:33:19 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:33:19 user nova-compute[74295]:   <serial>71a685cc-8c7f-4a69-8093-282313bfb0f4</serial>
Oct 26 06:33:19 user nova-compute[74295]: </disk>
Oct 26 06:33:19 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:33:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:33:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:33:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] No VIF found with MAC fa:16:3e:82:35:94, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:33:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-991df68f-8003-474f-bc14-70891005a113 tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.456s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG os_brick.utils [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac5ad63-7c9d-4f28-8c2d-e94fff981947]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6df36c-6704-4b3f-98fe-e40a5129a5f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc17019-16a5-4d23-8fd1-1ff4b0f70b03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[039268a9-f177-4852-b74a-19a9a424e8e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:33:20 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:33:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8675e821-3753-4a06-9580-1d88c303e1c4]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:33:20 user nova-compute[74295]: DEBUG os_brick.utils [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:20 user nova-compute[74295]: INFO nova.compute.manager [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Swapping volume 71a685cc-8c7f-4a69-8093-282313bfb0f4 for cac15c48-249b-4680-937f-d2ca8845d0f8
Oct 26 06:33:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:21 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:33:22 user nova-compute[74295]: INFO nova.compute.claims [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Claim successful on node user
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:33:22 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.policy [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91925e095e034d3cb49445f191f910b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beceb88c1357495f9a2a600dc7bbfa1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:33:22 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Creating image(s)
Oct 26 06:33:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "/opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "/opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.232s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Successfully created port: 9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk 1073741824" returned: 0 in 0.055s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Cannot resize image /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Ensure instance console log exists: /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Successfully updated port: 9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "refresh_cache-c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquired lock "refresh_cache-c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.compute.manager [req-d16ff2f1-d417-4939-ae70-e344ba872b37 req-85b82722-bee6-4670-ae54-c7baa737b333 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received event network-changed-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.compute.manager [req-d16ff2f1-d417-4939-ae70-e344ba872b37 req-85b82722-bee6-4670-ae54-c7baa737b333 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Refreshing instance network info cache due to event network-changed-9d4e229d-4afa-4070-b122-f56aaae1d450. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d16ff2f1-d417-4939-ae70-e344ba872b37 req-85b82722-bee6-4670-ae54-c7baa737b333 service nova] Acquiring lock "refresh_cache-c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:33:23 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Updating instance_info_cache with network_info: [{"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Releasing lock "refresh_cache-c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Instance network_info: |[{"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d16ff2f1-d417-4939-ae70-e344ba872b37 req-85b82722-bee6-4670-ae54-c7baa737b333 service nova] Acquired lock "refresh_cache-c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.network.neutron [req-d16ff2f1-d417-4939-ae70-e344ba872b37 req-85b82722-bee6-4670-ae54-c7baa737b333 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Refreshing network info cache for port 9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Start _get_guest_xml network_info=[{"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:33:24 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:33:24 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-212607490',display_name='tempest-ServersNegativeTestJSON-server-212607490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-212607490',id=20,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beceb88c1357495f9a2a600dc7bbfa1f',ramdisk_id='',reservation_id='r-mk4nr6mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-274276408',owner_user_name='tempest-ServersNegativeTestJSON-274276408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:33:23Z,user_data=None,user_id='91925e095e034d3cb49445f191f910b1',uuid=c9208b1d-a8e2-4806-942b-e19ebbe3e3d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converting VIF {"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:46:f3,bridge_name='br-int',has_traffic_filtering=True,id=9d4e229d-4afa-4070-b122-f56aaae1d450,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4e229d-4a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lazy-loading 'pci_devices' on Instance uuid c9208b1d-a8e2-4806-942b-e19ebbe3e3d9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:33:24 user nova-compute[74295]:   <uuid>c9208b1d-a8e2-4806-942b-e19ebbe3e3d9</uuid>
Oct 26 06:33:24 user nova-compute[74295]:   <name>instance-00000014</name>
Oct 26 06:33:24 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:33:24 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:33:24 user nova-compute[74295]:   <metadata>
Oct 26 06:33:24 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:33:24 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:33:24 user nova-compute[74295]:       <nova:name>tempest-ServersNegativeTestJSON-server-212607490</nova:name>
Oct 26 06:33:24 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:33:24</nova:creationTime>
Oct 26 06:33:24 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:33:24 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:33:24 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:33:24 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:33:24 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:33:24 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:33:24 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:33:24 user nova-compute[74295]:       <nova:owner>
Oct 26 06:33:24 user nova-compute[74295]:         <nova:user uuid="91925e095e034d3cb49445f191f910b1">tempest-ServersNegativeTestJSON-274276408-project-member</nova:user>
Oct 26 06:33:24 user nova-compute[74295]:         <nova:project uuid="beceb88c1357495f9a2a600dc7bbfa1f">tempest-ServersNegativeTestJSON-274276408</nova:project>
Oct 26 06:33:24 user nova-compute[74295]:       </nova:owner>
Oct 26 06:33:24 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:33:24 user nova-compute[74295]:       <nova:ports>
Oct 26 06:33:24 user nova-compute[74295]:         <nova:port uuid="9d4e229d-4afa-4070-b122-f56aaae1d450">
Oct 26 06:33:24 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 06:33:24 user nova-compute[74295]:         </nova:port>
Oct 26 06:33:24 user nova-compute[74295]:       </nova:ports>
Oct 26 06:33:24 user nova-compute[74295]:     </nova:instance>
Oct 26 06:33:24 user nova-compute[74295]:   </metadata>
Oct 26 06:33:24 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:33:24 user nova-compute[74295]:     <system>
Oct 26 06:33:24 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:33:24 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:33:24 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:33:24 user nova-compute[74295]:       <entry name="serial">c9208b1d-a8e2-4806-942b-e19ebbe3e3d9</entry>
Oct 26 06:33:24 user nova-compute[74295]:       <entry name="uuid">c9208b1d-a8e2-4806-942b-e19ebbe3e3d9</entry>
Oct 26 06:33:24 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:33:24 user nova-compute[74295]:     </system>
Oct 26 06:33:24 user nova-compute[74295]:   </sysinfo>
Oct 26 06:33:24 user nova-compute[74295]:   <os>
Oct 26 06:33:24 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:33:24 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:33:24 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:33:24 user nova-compute[74295]:   </os>
Oct 26 06:33:24 user nova-compute[74295]:   <features>
Oct 26 06:33:24 user nova-compute[74295]:     <acpi/>
Oct 26 06:33:24 user nova-compute[74295]:     <apic/>
Oct 26 06:33:24 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:33:24 user nova-compute[74295]:   </features>
Oct 26 06:33:24 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:33:24 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:33:24 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:33:24 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:33:24 user nova-compute[74295]:   </clock>
Oct 26 06:33:24 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:33:24 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:33:24 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:33:24 user nova-compute[74295]:   </cpu>
Oct 26 06:33:24 user nova-compute[74295]:   <devices>
Oct 26 06:33:24 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:33:24 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:33:24 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk"/>
Oct 26 06:33:24 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:33:24 user nova-compute[74295]:     </disk>
Oct 26 06:33:24 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:33:24 user nova-compute[74295]:       <mac address="fa:16:3e:3f:46:f3"/>
Oct 26 06:33:24 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:33:24 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:33:24 user nova-compute[74295]:       <target dev="tap9d4e229d-4a"/>
Oct 26 06:33:24 user nova-compute[74295]:     </interface>
Oct 26 06:33:24 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:33:24 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/console.log" append="off"/>
Oct 26 06:33:24 user nova-compute[74295]:     </serial>
Oct 26 06:33:24 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:33:24 user nova-compute[74295]:     <video>
Oct 26 06:33:24 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:33:24 user nova-compute[74295]:     </video>
Oct 26 06:33:24 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:33:24 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:33:24 user nova-compute[74295]:     </rng>
Oct 26 06:33:24 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:33:24 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:33:24 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:33:24 user nova-compute[74295]:     </memballoon>
Oct 26 06:33:24 user nova-compute[74295]:   </devices>
Oct 26 06:33:24 user nova-compute[74295]: </domain>
Oct 26 06:33:24 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-212607490',display_name='tempest-ServersNegativeTestJSON-server-212607490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-212607490',id=20,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beceb88c1357495f9a2a600dc7bbfa1f',ramdisk_id='',reservation_id='r-mk4nr6mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-274276408',owner_user_name='tempest-ServersNegativeTestJSON-274276408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:33:23Z,user_data=None,user_id='91925e095e034d3cb49445f191f910b1',uuid=c9208b1d-a8e2-4806-942b-e19ebbe3e3d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converting VIF {"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:46:f3,bridge_name='br-int',has_traffic_filtering=True,id=9d4e229d-4afa-4070-b122-f56aaae1d450,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4e229d-4a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG os_vif [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:46:f3,bridge_name='br-int',has_traffic_filtering=True,id=9d4e229d-4afa-4070-b122-f56aaae1d450,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4e229d-4a') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eed52823-54bb-5e39-a2c5-f4e3dddfa12d', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d4e229d-4a, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d4e229d-4a, col_values=(('qos', UUID('799f49c7-8649-4283-8dcb-9abea4dfc92b')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d4e229d-4a, col_values=(('external_ids', {'iface-id': '9d4e229d-4afa-4070-b122-f56aaae1d450', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:46:f3', 'vm-uuid': 'c9208b1d-a8e2-4806-942b-e19ebbe3e3d9'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:24 user nova-compute[74295]: INFO os_vif [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:46:f3,bridge_name='br-int',has_traffic_filtering=True,id=9d4e229d-4afa-4070-b122-f56aaae1d450,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4e229d-4a')
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] No VIF found with MAC fa:16:3e:3f:46:f3, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.network.neutron [req-d16ff2f1-d417-4939-ae70-e344ba872b37 req-85b82722-bee6-4670-ae54-c7baa737b333 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Updated VIF entry in instance network info cache for port 9d4e229d-4afa-4070-b122-f56aaae1d450. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG nova.network.neutron [req-d16ff2f1-d417-4939-ae70-e344ba872b37 req-85b82722-bee6-4670-ae54-c7baa737b333 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Updating instance_info_cache with network_info: [{"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:33:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d16ff2f1-d417-4939-ae70-e344ba872b37 req-85b82722-bee6-4670-ae54-c7baa737b333 service nova] Releasing lock "refresh_cache-c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:33:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-de9cd87e-33ba-4e26-8900-6bc7f8b167a2 req-ee1f16d9-2940-49e0-83da-6424f802c941 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received event network-vif-plugged-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-de9cd87e-33ba-4e26-8900-6bc7f8b167a2 req-ee1f16d9-2940-49e0-83da-6424f802c941 service nova] Acquiring lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-de9cd87e-33ba-4e26-8900-6bc7f8b167a2 req-ee1f16d9-2940-49e0-83da-6424f802c941 service nova] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-de9cd87e-33ba-4e26-8900-6bc7f8b167a2 req-ee1f16d9-2940-49e0-83da-6424f802c941 service nova] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-de9cd87e-33ba-4e26-8900-6bc7f8b167a2 req-ee1f16d9-2940-49e0-83da-6424f802c941 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] No waiting events found dispatching network-vif-plugged-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:25 user nova-compute[74295]: WARNING nova.compute.manager [req-de9cd87e-33ba-4e26-8900-6bc7f8b167a2 req-ee1f16d9-2940-49e0-83da-6424f802c941 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received unexpected event network-vif-plugged-9d4e229d-4afa-4070-b122-f56aaae1d450 for instance with vm_state building and task_state spawning.
Oct 26 06:33:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:33:26 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Creating image(s)
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Ensure instance console log exists: /opt/stack/data/nova/instances/6b441689-7c38-455d-a55e-6cd9615049cf/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Start _get_guest_xml network_info=[{"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '53da720e-3087-439f-a652-40edf0eab1e4', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtyxVqzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b441689-7c38-455d-a55e-6cd9615049cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'f879a984-b889-46ee-9eeb-db8d85769e7f', 'serial': 'f879a984-b889-46ee-9eeb-db8d85769e7f'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:33:26 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:33:26 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtyxVqzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:26 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:26 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:26 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d092f1-ffc7-4f23-b0db-8608120c9938]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:33:26 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b1019-5331-4eee-b5f5-943895102b75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f] added
Oct 26 06:33:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ee2ce4-c8da-40ad-8de2-af0448f1fec0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c6c895-5a72-4491-8491-6f0931d7c88c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EtyxVqzM {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EtyxVqzM" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a06cdc-6742-448f-b419-2e57c0ab8a92]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EtyxVqzM'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f777cb2-8233-447c-909d-122bf329e6d9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[967ea384-8315-4e72-8716-8f4c9df6d78e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb3befe-5292-4164-a7cc-52d1b7d3c096]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260]
Oct 26 06:33:26 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260] successful.
Oct 26 06:33:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8ba027-21ae-42dd-85cb-42ef1e638698]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71d6531-5c93-4790-99e3-9c69f53b1583]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:26 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f482e1f4-7d19-4bdb-9bd7-7e0e1c5b6425]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtyxVqzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:33:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23766656263373937', 'path': '/dev/sdf'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766656263373937', 'path': '/dev/sdf'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1953981053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1953981053',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW+yK605nx9fsnK9sPq0DGNEhK8lBG6yyAJakl9nS8lcsLe1dpyuMk9N+CMReZkLMBKhi5isWdyprLJbwq8wWYSZ9E2mQUuQM8J+Nd843KWCgj43KxseMsp4FEzwwenUw==',key_name='tempest-keypair-986045003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ec6997c8d74b10901d0d1edca094c8',ramdisk_id='',reservation_id='r-n0bmm11a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1864822632',owner_user_name='tempest-ServerActionsV293TestJSON-1864822632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:33:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='463ace29d09f4b9d9460901159b82aca',uuid=6b441689-7c38-455d-a55e-6cd9615049cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converting VIF {"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.objects.instance [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b441689-7c38-455d-a55e-6cd9615049cf {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:33:27 user nova-compute[74295]:   <uuid>6b441689-7c38-455d-a55e-6cd9615049cf</uuid>
Oct 26 06:33:27 user nova-compute[74295]:   <name>instance-00000013</name>
Oct 26 06:33:27 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:33:27 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:33:27 user nova-compute[74295]:   <metadata>
Oct 26 06:33:27 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:33:27 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:33:27 user nova-compute[74295]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1953981053</nova:name>
Oct 26 06:33:27 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:33:26</nova:creationTime>
Oct 26 06:33:27 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:33:27 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:33:27 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:33:27 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:33:27 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:33:27 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:33:27 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:33:27 user nova-compute[74295]:       <nova:owner>
Oct 26 06:33:27 user nova-compute[74295]:         <nova:user uuid="463ace29d09f4b9d9460901159b82aca">tempest-ServerActionsV293TestJSON-1864822632-project-member</nova:user>
Oct 26 06:33:27 user nova-compute[74295]:         <nova:project uuid="51ec6997c8d74b10901d0d1edca094c8">tempest-ServerActionsV293TestJSON-1864822632</nova:project>
Oct 26 06:33:27 user nova-compute[74295]:       </nova:owner>
Oct 26 06:33:27 user nova-compute[74295]:       <nova:ports>
Oct 26 06:33:27 user nova-compute[74295]:         <nova:port uuid="16d2b3ee-0200-4890-918e-3caddf53dcaa">
Oct 26 06:33:27 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 06:33:27 user nova-compute[74295]:         </nova:port>
Oct 26 06:33:27 user nova-compute[74295]:       </nova:ports>
Oct 26 06:33:27 user nova-compute[74295]:     </nova:instance>
Oct 26 06:33:27 user nova-compute[74295]:   </metadata>
Oct 26 06:33:27 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:33:27 user nova-compute[74295]:     <system>
Oct 26 06:33:27 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:33:27 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:33:27 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:33:27 user nova-compute[74295]:       <entry name="serial">6b441689-7c38-455d-a55e-6cd9615049cf</entry>
Oct 26 06:33:27 user nova-compute[74295]:       <entry name="uuid">6b441689-7c38-455d-a55e-6cd9615049cf</entry>
Oct 26 06:33:27 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:33:27 user nova-compute[74295]:     </system>
Oct 26 06:33:27 user nova-compute[74295]:   </sysinfo>
Oct 26 06:33:27 user nova-compute[74295]:   <os>
Oct 26 06:33:27 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:33:27 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:33:27 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:33:27 user nova-compute[74295]:   </os>
Oct 26 06:33:27 user nova-compute[74295]:   <features>
Oct 26 06:33:27 user nova-compute[74295]:     <acpi/>
Oct 26 06:33:27 user nova-compute[74295]:     <apic/>
Oct 26 06:33:27 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:33:27 user nova-compute[74295]:   </features>
Oct 26 06:33:27 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:33:27 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:33:27 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:33:27 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:33:27 user nova-compute[74295]:   </clock>
Oct 26 06:33:27 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:33:27 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:33:27 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:33:27 user nova-compute[74295]:   </cpu>
Oct 26 06:33:27 user nova-compute[74295]:   <devices>
Oct 26 06:33:27 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:33:27 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:33:27 user nova-compute[74295]:       <source dev="/dev/sdf"/>
Oct 26 06:33:27 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:33:27 user nova-compute[74295]:       <serial>f879a984-b889-46ee-9eeb-db8d85769e7f</serial>
Oct 26 06:33:27 user nova-compute[74295]:     </disk>
Oct 26 06:33:27 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:33:27 user nova-compute[74295]:       <mac address="fa:16:3e:12:22:a2"/>
Oct 26 06:33:27 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:33:27 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:33:27 user nova-compute[74295]:       <target dev="tap16d2b3ee-02"/>
Oct 26 06:33:27 user nova-compute[74295]:     </interface>
Oct 26 06:33:27 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:33:27 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/6b441689-7c38-455d-a55e-6cd9615049cf/console.log" append="off"/>
Oct 26 06:33:27 user nova-compute[74295]:     </serial>
Oct 26 06:33:27 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:33:27 user nova-compute[74295]:     <video>
Oct 26 06:33:27 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:33:27 user nova-compute[74295]:     </video>
Oct 26 06:33:27 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:33:27 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:33:27 user nova-compute[74295]:     </rng>
Oct 26 06:33:27 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:33:27 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:33:27 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:33:27 user nova-compute[74295]:     </memballoon>
Oct 26 06:33:27 user nova-compute[74295]:   </devices>
Oct 26 06:33:27 user nova-compute[74295]: </domain>
Oct 26 06:33:27 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1953981053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1953981053',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW+yK605nx9fsnK9sPq0DGNEhK8lBG6yyAJakl9nS8lcsLe1dpyuMk9N+CMReZkLMBKhi5isWdyprLJbwq8wWYSZ9E2mQUuQM8J+Nd843KWCgj43KxseMsp4FEzwwenUw==',key_name='tempest-keypair-986045003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ec6997c8d74b10901d0d1edca094c8',ramdisk_id='',reservation_id='r-n0bmm11a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1864822632',owner_user_name='tempest-ServerActionsV293TestJSON-1864822632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:33:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='463ace29d09f4b9d9460901159b82aca',uuid=6b441689-7c38-455d-a55e-6cd9615049cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converting VIF {"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG os_vif [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4a84724-7713-5512-9da6-9220e8fe1987', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16d2b3ee-02, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16d2b3ee-02, col_values=(('qos', UUID('e68ee65d-eee2-435f-85a6-93a27785cc6c')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16d2b3ee-02, col_values=(('external_ids', {'iface-id': '16d2b3ee-0200-4890-918e-3caddf53dcaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:22:a2', 'vm-uuid': '6b441689-7c38-455d-a55e-6cd9615049cf'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:27 user nova-compute[74295]: INFO os_vif [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02')
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] No VIF found with MAC fa:16:3e:12:22:a2, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:33:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Instance spawned successfully.
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.compute.manager [req-9a8f3f3c-2a74-42dd-b82c-c0a649cfdd40 req-1e368a0a-4e65-4a89-9242-c77e49d0ecfe service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received event network-vif-plugged-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9a8f3f3c-2a74-42dd-b82c-c0a649cfdd40 req-1e368a0a-4e65-4a89-9242-c77e49d0ecfe service nova] Acquiring lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9a8f3f3c-2a74-42dd-b82c-c0a649cfdd40 req-1e368a0a-4e65-4a89-9242-c77e49d0ecfe service nova] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9a8f3f3c-2a74-42dd-b82c-c0a649cfdd40 req-1e368a0a-4e65-4a89-9242-c77e49d0ecfe service nova] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.compute.manager [req-9a8f3f3c-2a74-42dd-b82c-c0a649cfdd40 req-1e368a0a-4e65-4a89-9242-c77e49d0ecfe service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] No waiting events found dispatching network-vif-plugged-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:27 user nova-compute[74295]: WARNING nova.compute.manager [req-9a8f3f3c-2a74-42dd-b82c-c0a649cfdd40 req-1e368a0a-4e65-4a89-9242-c77e49d0ecfe service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received unexpected event network-vif-plugged-9d4e229d-4afa-4070-b122-f56aaae1d450 for instance with vm_state building and task_state spawning.
Oct 26 06:33:27 user nova-compute[74295]: INFO nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Took 5.17 seconds to spawn the instance on the hypervisor.
Oct 26 06:33:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:33:28 user nova-compute[74295]: INFO nova.compute.manager [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Took 6.08 seconds to build instance.
Oct 26 06:33:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9b549407-3bc3-4775-b608-c813b4982e4e tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.182s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] No waiting events found dispatching network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:30 user nova-compute[74295]: WARNING nova.compute.manager [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received unexpected event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa for instance with vm_state building and task_state spawning.
Oct 26 06:33:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] No waiting events found dispatching network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:30 user nova-compute[74295]: WARNING nova.compute.manager [req-b8ce38b1-8988-4410-a707-cf294294ef85 req-c02380e0-d7f2-46a8-b79d-8141a356514a service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received unexpected event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa for instance with vm_state building and task_state spawning.
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:33:31 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance spawned successfully.
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:33:31 user nova-compute[74295]: INFO nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 26 06:33:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:33:31 user nova-compute[74295]: INFO nova.compute.manager [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Took 27.98 seconds to build instance.
Oct 26 06:33:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ff4645d1-08e7-4a28-9083-ec5860401047 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "6b441689-7c38-455d-a55e-6cd9615049cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.100s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Starting finish_revert_migration {{(pid=74295) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Start _get_guest_xml network_info=[{"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '0c6ae466-a026-47d2-a6c6-135d60f6151f', 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '775d5e2e-95a6-4a86-b6f3-ce96735378d9', 'attached_at': '2023-10-26T06:33:35.000000', 'detached_at': '', 'volume_id': '0f212bc3-b89c-4588-9186-df7b86c44e6b', 'serial': '0f212bc3-b89c-4588-9186-df7b86c44e6b'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:33:34 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:33:34 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.objects.instance [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lazy-loading 'vcpu_model' on Instance uuid 775d5e2e-95a6-4a86-b6f3-ce96735378d9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:34 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:34 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:34 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe18d446-cf29-42be-9f0e-5256e98371cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:33:34 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b418f-cd28-4965-a491-638825e1af2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b] added
Oct 26 06:33:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8586f846-4992-49f0-8f48-405b4a927d68]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c6603d-8f8f-47c1-aba3-167895ed047b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFgsenmy {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RFgsenmy" returned: 0 in 0.035s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cb751f-3d40-44f8-9bf8-9003899b4e1c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RFgsenmy'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0442b31-7b4c-47dc-8b29-009bc1ca40e4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d8a99a-003b-419e-8ce0-59950168eb48]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d32a6ae-8e53-457d-9b93-24ef75b76c91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]
Oct 26 06:33:35 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.
Oct 26 06:33:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d241fc-46dd-455c-9f2e-542d9e4fa98f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd758259-3a2d-4b88-9884-ac3f6fc92ea6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:35 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3319498-9b31-4133-987f-4bd38f85cb53]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:33:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23661646561646436', 'path': '/dev/sdg'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661646561646436', 'path': '/dev/sdg'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-97936637',display_name='tempest-ServerActionsTestOtherB-server-97936637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-97936637',id=4,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmm1IaoBoVd8Hkv3gtx/L78lFPzYOW0A2Qqc9FfseOv4MiM64O4tVX1rCM39AF+LH46KHkGVTicvdWviQLc+ppyTXiLGRvBGUpaFnTBwUaROd5zinEiEdd3gXRLbgwTBg==',key_name='tempest-keypair-393220372',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:31:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd8a2b9f8cce49d4985549fd42dc1e8a',ramdisk_id='',reservation_id='r-cmxn1myp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-406693711',owner_user_name='tempest-ServerActionsTestOtherB-406693711-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e44a6886b2b478dbca031edd15a9a6f',uuid=775d5e2e-95a6-4a86-b6f3-ce96735378d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converting VIF {"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:33:36 user nova-compute[74295]:   <uuid>775d5e2e-95a6-4a86-b6f3-ce96735378d9</uuid>
Oct 26 06:33:36 user nova-compute[74295]:   <name>instance-00000004</name>
Oct 26 06:33:36 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:33:36 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:33:36 user nova-compute[74295]:   <metadata>
Oct 26 06:33:36 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:33:36 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:33:36 user nova-compute[74295]:       <nova:name>tempest-ServerActionsTestOtherB-server-97936637</nova:name>
Oct 26 06:33:36 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:33:34</nova:creationTime>
Oct 26 06:33:36 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:33:36 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:33:36 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:33:36 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:33:36 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:33:36 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:33:36 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:33:36 user nova-compute[74295]:       <nova:owner>
Oct 26 06:33:36 user nova-compute[74295]:         <nova:user uuid="8e44a6886b2b478dbca031edd15a9a6f">tempest-ServerActionsTestOtherB-406693711-project-member</nova:user>
Oct 26 06:33:36 user nova-compute[74295]:         <nova:project uuid="dd8a2b9f8cce49d4985549fd42dc1e8a">tempest-ServerActionsTestOtherB-406693711</nova:project>
Oct 26 06:33:36 user nova-compute[74295]:       </nova:owner>
Oct 26 06:33:36 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:33:36 user nova-compute[74295]:       <nova:ports>
Oct 26 06:33:36 user nova-compute[74295]:         <nova:port uuid="f0e3fe7f-b73a-48b6-bc9d-adac272022b4">
Oct 26 06:33:36 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 06:33:36 user nova-compute[74295]:         </nova:port>
Oct 26 06:33:36 user nova-compute[74295]:       </nova:ports>
Oct 26 06:33:36 user nova-compute[74295]:     </nova:instance>
Oct 26 06:33:36 user nova-compute[74295]:   </metadata>
Oct 26 06:33:36 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:33:36 user nova-compute[74295]:     <system>
Oct 26 06:33:36 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:33:36 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:33:36 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:33:36 user nova-compute[74295]:       <entry name="serial">775d5e2e-95a6-4a86-b6f3-ce96735378d9</entry>
Oct 26 06:33:36 user nova-compute[74295]:       <entry name="uuid">775d5e2e-95a6-4a86-b6f3-ce96735378d9</entry>
Oct 26 06:33:36 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:33:36 user nova-compute[74295]:     </system>
Oct 26 06:33:36 user nova-compute[74295]:   </sysinfo>
Oct 26 06:33:36 user nova-compute[74295]:   <os>
Oct 26 06:33:36 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:33:36 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:33:36 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:33:36 user nova-compute[74295]:   </os>
Oct 26 06:33:36 user nova-compute[74295]:   <features>
Oct 26 06:33:36 user nova-compute[74295]:     <acpi/>
Oct 26 06:33:36 user nova-compute[74295]:     <apic/>
Oct 26 06:33:36 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:33:36 user nova-compute[74295]:   </features>
Oct 26 06:33:36 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:33:36 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:33:36 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:33:36 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:33:36 user nova-compute[74295]:   </clock>
Oct 26 06:33:36 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:33:36 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:33:36 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:33:36 user nova-compute[74295]:   </cpu>
Oct 26 06:33:36 user nova-compute[74295]:   <devices>
Oct 26 06:33:36 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:33:36 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:33:36 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk"/>
Oct 26 06:33:36 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:33:36 user nova-compute[74295]:     </disk>
Oct 26 06:33:36 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:33:36 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:33:36 user nova-compute[74295]:       <source dev="/dev/sdg"/>
Oct 26 06:33:36 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:33:36 user nova-compute[74295]:       <serial>0f212bc3-b89c-4588-9186-df7b86c44e6b</serial>
Oct 26 06:33:36 user nova-compute[74295]:     </disk>
Oct 26 06:33:36 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:33:36 user nova-compute[74295]:       <mac address="fa:16:3e:ad:4f:d9"/>
Oct 26 06:33:36 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:33:36 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:33:36 user nova-compute[74295]:       <target dev="tapf0e3fe7f-b7"/>
Oct 26 06:33:36 user nova-compute[74295]:     </interface>
Oct 26 06:33:36 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:33:36 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/console.log" append="off"/>
Oct 26 06:33:36 user nova-compute[74295]:     </serial>
Oct 26 06:33:36 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:33:36 user nova-compute[74295]:     <video>
Oct 26 06:33:36 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:33:36 user nova-compute[74295]:     </video>
Oct 26 06:33:36 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:33:36 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:33:36 user nova-compute[74295]:     </rng>
Oct 26 06:33:36 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:33:36 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:33:36 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:33:36 user nova-compute[74295]:     </memballoon>
Oct 26 06:33:36 user nova-compute[74295]:   </devices>
Oct 26 06:33:36 user nova-compute[74295]: </domain>
Oct 26 06:33:36 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-97936637',display_name='tempest-ServerActionsTestOtherB-server-97936637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-97936637',id=4,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmm1IaoBoVd8Hkv3gtx/L78lFPzYOW0A2Qqc9FfseOv4MiM64O4tVX1rCM39AF+LH46KHkGVTicvdWviQLc+ppyTXiLGRvBGUpaFnTBwUaROd5zinEiEdd3gXRLbgwTBg==',key_name='tempest-keypair-393220372',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:31:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd8a2b9f8cce49d4985549fd42dc1e8a',ramdisk_id='',reservation_id='r-cmxn1myp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-406693711',owner_user_name='tempest-ServerActionsTestOtherB-406693711-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e44a6886b2b478dbca031edd15a9a6f',uuid=775d5e2e-95a6-4a86-b6f3-ce96735378d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converting VIF {"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG os_vif [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09c8a9b3-4d0d-53c7-b32d-edd04837daa9', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0e3fe7f-b7, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0e3fe7f-b7, col_values=(('qos', UUID('559cee94-7feb-4364-922f-545af20adce6')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0e3fe7f-b7, col_values=(('external_ids', {'iface-id': 'f0e3fe7f-b73a-48b6-bc9d-adac272022b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:4f:d9', 'vm-uuid': '775d5e2e-95a6-4a86-b6f3-ce96735378d9'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:33:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:36 user nova-compute[74295]: INFO os_vif [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7')
Oct 26 06:33:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b153e78-934a-4b0b-adfb-8163b293af2f req-b84e49bc-b1d5-4b0e-ad2f-1029e662715c service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b153e78-934a-4b0b-adfb-8163b293af2f req-b84e49bc-b1d5-4b0e-ad2f-1029e662715c service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b153e78-934a-4b0b-adfb-8163b293af2f req-b84e49bc-b1d5-4b0e-ad2f-1029e662715c service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b153e78-934a-4b0b-adfb-8163b293af2f req-b84e49bc-b1d5-4b0e-ad2f-1029e662715c service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b153e78-934a-4b0b-adfb-8163b293af2f req-b84e49bc-b1d5-4b0e-ad2f-1029e662715c service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:38 user nova-compute[74295]: WARNING nova.compute.manager [req-9b153e78-934a-4b0b-adfb-8163b293af2f req-b84e49bc-b1d5-4b0e-ad2f-1029e662715c service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state resized and task_state resize_reverting.
Oct 26 06:33:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-bc4b3daa-c59a-4f90-a7e3-b09a44a315ae req-0308103b-dad6-439c-8d5b-2776c75249ca service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bc4b3daa-c59a-4f90-a7e3-b09a44a315ae req-0308103b-dad6-439c-8d5b-2776c75249ca service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bc4b3daa-c59a-4f90-a7e3-b09a44a315ae req-0308103b-dad6-439c-8d5b-2776c75249ca service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bc4b3daa-c59a-4f90-a7e3-b09a44a315ae req-0308103b-dad6-439c-8d5b-2776c75249ca service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-bc4b3daa-c59a-4f90-a7e3-b09a44a315ae req-0308103b-dad6-439c-8d5b-2776c75249ca service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:33:40 user nova-compute[74295]: WARNING nova.compute.manager [req-bc4b3daa-c59a-4f90-a7e3-b09a44a315ae req-0308103b-dad6-439c-8d5b-2776c75249ca service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state resized and task_state resize_reverting.
Oct 26 06:33:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:33:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance running successfully.
Oct 26 06:33:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] finish_revert_migration finished successfully. {{(pid=74295) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 26 06:33:40 user nova-compute[74295]: INFO nova.compute.manager [None req-331c1148-5b82-4dcc-ab8f-cb2bbf750c0e tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance to original state: 'active'
Oct 26 06:33:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLKeJjpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b1f13ee5-22e7-466c-a117-ae4a707ad2bc', 'attached_at': '', 'detached_at': '', 'volume_id': 'cac15c48-249b-4680-937f-d2ca8845d0f8', 'serial': 'cac15c48-249b-4680-937f-d2ca8845d0f8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVCyRArE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b1f13ee5-22e7-466c-a117-ae4a707ad2bc', 'attached_at': '', 'detached_at': '', 'volume_id': '71a685cc-8c7f-4a69-8093-282313bfb0f4', 'serial'} {{(pid=74295) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLKeJjpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:42 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:42 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:42 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e68b9df-83d7-4d3f-bfa8-a876fef99ecb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:33:42 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfbdaba-a051-47b2-ad64-6759be571306]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8] added
Oct 26 06:33:42 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4f4e63-98a1-42e3-b99a-1d6cf0fff224]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7d7db4-ebb1-48c3-851b-9decf3df761b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLKeJjpw {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLKeJjpw" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1e12ce-d148-43ab-92a9-aba7aec8e495]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sLKeJjpw'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a0fb2d-336d-4c1f-b96d-f150a5a80a94]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f99946-7c01-420d-904d-0edc37010635]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:42 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:42 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[167cab7e-4a6c-45af-8e33-7d6da3735712]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8, portal: 172.16.0.220,3260]
Oct 26 06:33:42 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8, portal: 172.16.0.220,3260] successful.
Oct 26 06:33:42 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f850291a-7a24-49ee-a736-665a99857ab0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[572eac60-fdfe-47eb-810c-ac4a268d7538]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:42 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:33:42 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[32722e3d-336d-47fb-99fc-2ce9d2a9896b]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:33:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLKeJjpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:33:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:43 user nova-compute[74295]: INFO nova.compute.manager [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Detaching volume 7927ba84-e82d-4502-b7de-9d9e78742ad5
Oct 26 06:33:43 user nova-compute[74295]: INFO nova.virt.block_device [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Attempting to driver detach volume 7927ba84-e82d-4502-b7de-9d9e78742ad5 from mountpoint /dev/vdb
Oct 26 06:33:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Attempting to detach device vdb from instance 1229385f-194e-482e-ac54-ca9cc2591edd from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:33:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:33:43 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:33:43 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:33:43 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:33:43 user nova-compute[74295]:   <serial>7927ba84-e82d-4502-b7de-9d9e78742ad5</serial>
Oct 26 06:33:43 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:33:43 user nova-compute[74295]: </disk>
Oct 26 06:33:43 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:33:43 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Successfully detached device vdb from instance 1229385f-194e-482e-ac54-ca9cc2591edd from the persistent domain config.
Oct 26 06:33:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1229385f-194e-482e-ac54-ca9cc2591edd from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:33:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:33:43 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:33:43 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:33:43 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:33:43 user nova-compute[74295]:   <serial>7927ba84-e82d-4502-b7de-9d9e78742ad5</serial>
Oct 26 06:33:43 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:33:43 user nova-compute[74295]: </disk>
Oct 26 06:33:43 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:33:43 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:43 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23631333132633563', 'path': '/dev/sdh'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631333132633563', 'path': '/dev/sdh'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:33:43 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lazy-loading 'flavor' on Instance uuid b1f13ee5-22e7-466c-a117-ae4a707ad2bc {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:33:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 125829120 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 282066944 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 308281344 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 358612992 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 537919488 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 725614592 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 902823936 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 996147200 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVCyRArE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:49 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f07d97-6fd3-4ca7-b4e9-e8728c27025f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:33:49 user nova-compute[74295]: No targets found.
Oct 26 06:33:49 user nova-compute[74295]: iSNS:
Oct 26 06:33:49 user nova-compute[74295]: No targets found.
Oct 26 06:33:49 user nova-compute[74295]: STATIC:
Oct 26 06:33:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:33:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5
Oct 26 06:33:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8
Oct 26 06:33:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4
Oct 26 06:33:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f
Oct 26 06:33:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:33:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:33:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:33:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:33:49 user nova-compute[74295]: FIRMWARE:
Oct 26 06:33:49 user nova-compute[74295]: No targets found.
Oct 26 06:33:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:33:49 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:33:49 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfa1294-49c0-4d64-aa86-0e574d8c9cfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[925cb684-31b6-41a7-82a8-f822851491e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:33:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:33:49 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:33:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1bfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4bcafc-2042-4d57-a53b-eb68ae5367fe]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a1ebfc-91c7-4854-a5df-fde3087b9351]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c8191f-457b-446a-b4b5-cc1ae321fd5b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca3d997-4974-44d0-a446-76e73c990bed]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17e4c31-89e3-4956-b362-da85a60a4313]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ca4ea-e119-4751-8deb-0662ce071825]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4, portal: 172.16.0.220,3260]
Oct 26 06:33:49 user nova-compute[74295]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4, portal: 172.16.0.220,3260] successful.
Oct 26 06:33:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a685cc-8c7f-4a69-8093-282313bfb0f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff580bc0-7298-41dc-b49c-888050127377]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] <== disconnect_volume: return (400ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLKeJjpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'b1f13ee5-22e7-466c-a117-ae4a707ad2bc', 'attached_at': '', 'detached_at': '', 'volume_id': 'cac15c48-249b-4680-937f-d2ca8845d0f8', 'serial'} {{(pid=74295) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 26 06:33:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] swap_volume: removing Cinder connection for volume 71a685cc-8c7f-4a69-8093-282313bfb0f4 {{(pid=74295) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 26 06:33:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] swap_volume: Updating volume 71a685cc-8c7f-4a69-8093-282313bfb0f4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "sLKeJjpw", "auth_password": "fiSBp2cCN194Hk", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "cac15c48-249b-4680-937f-d2ca8845d0f8"}, "status": "reserved", "instance": "b1f13ee5-22e7-466c-a117-ae4a707ad2bc", "attached_at": "", "detached_at": "", "volume_id": "cac15c48-249b-4680-937f-d2ca8845d0f8", "serial": "cac15c48-249b-4680-937f-d2ca8845d0f8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'cac15c48-249b-4680-937f-d2ca8845d0f8', 'no_device': None, 'attachment_id': 'c23e93e2-ceb9-4709-93fb-dbaddc371e2b'} {{(pid=74295) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 26 06:33:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f135960f-ee32-4bb4-ac7e-fcf88e71a54a tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.388s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG os_brick.utils [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf44162-fb75-4959-be0f-91ea036ac3c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[383f35a9-ab72-4bca-89a7-fa7e2b4b74a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6aac60-9262-4985-90e7-c51ed8b6f79a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[addb4515-282e-40ac-8a88-9ad97cfbb48e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:33:51 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:33:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad2d635-ba6d-48f4-9622-d18d7fd88460]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG os_brick.utils [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:33:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:51 user nova-compute[74295]: INFO nova.compute.manager [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Swapping volume cac15c48-249b-4680-937f-d2ca8845d0f8 for 71a685cc-8c7f-4a69-8093-282313bfb0f4
Oct 26 06:33:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-55af5fc9-68d9-4da3-8d2c-6d40eb3a3ac7 req-f9554cc0-9a5d-4840-9ecb-5d6497035122 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received event network-changed-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:33:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-55af5fc9-68d9-4da3-8d2c-6d40eb3a3ac7 req-f9554cc0-9a5d-4840-9ecb-5d6497035122 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Refreshing instance network info cache due to event network-changed-c9f250c3-be94-4dd5-bee9-8c5b55470cf8. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:33:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-55af5fc9-68d9-4da3-8d2c-6d40eb3a3ac7 req-f9554cc0-9a5d-4840-9ecb-5d6497035122 service nova] Acquiring lock "refresh_cache-d98449c4-fbe5-44cc-82d4-d5d88b28c68d" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:33:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-55af5fc9-68d9-4da3-8d2c-6d40eb3a3ac7 req-f9554cc0-9a5d-4840-9ecb-5d6497035122 service nova] Acquired lock "refresh_cache-d98449c4-fbe5-44cc-82d4-d5d88b28c68d" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:33:53 user nova-compute[74295]: DEBUG nova.network.neutron [req-55af5fc9-68d9-4da3-8d2c-6d40eb3a3ac7 req-f9554cc0-9a5d-4840-9ecb-5d6497035122 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Refreshing network info cache for port c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:33:54 user nova-compute[74295]: DEBUG nova.network.neutron [req-55af5fc9-68d9-4da3-8d2c-6d40eb3a3ac7 req-f9554cc0-9a5d-4840-9ecb-5d6497035122 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Updated VIF entry in instance network info cache for port c9f250c3-be94-4dd5-bee9-8c5b55470cf8. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:33:54 user nova-compute[74295]: DEBUG nova.network.neutron [req-55af5fc9-68d9-4da3-8d2c-6d40eb3a3ac7 req-f9554cc0-9a5d-4840-9ecb-5d6497035122 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Updating instance_info_cache with network_info: [{"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:33:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-55af5fc9-68d9-4da3-8d2c-6d40eb3a3ac7 req-f9554cc0-9a5d-4840-9ecb-5d6497035122 service nova] Releasing lock "refresh_cache-d98449c4-fbe5-44cc-82d4-d5d88b28c68d" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:33:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:33:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:33:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:33:59 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'flavor' on Instance uuid d98449c4-fbe5-44cc-82d4-d5d88b28c68d {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:33:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:00 user nova-compute[74295]: INFO nova.compute.manager [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Attaching volume fc733cb5-132f-4e4d-8276-6c468866b1d9 to /dev/vdb
Oct 26 06:34:00 user nova-compute[74295]: DEBUG os_brick.utils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff3d098-9669-48ef-8d9f-ffdaf6f2ec87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[40559b71-7a2c-4323-99e8-b221db28d575]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4db178-ba2e-4bc8-96d2-898524cf90c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f43b7-eaf3-4fa9-9fb1-0ebc90d5173c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:34:00 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:34:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[274bcd73-0662-43b9-a470-2abf8bebcb22]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG os_brick.utils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:34:00 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Updating existing volume attachment record: 8a9dd50b-1834-44d5-8b96-c13b19a163a9 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:34:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:01 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:03 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1229385f-194e-482e-ac54-ca9cc2591edd is timed out.
Oct 26 06:34:03 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Successfully detached device vdb from instance 1229385f-194e-482e-ac54-ca9cc2591edd from the live domain config.
Oct 26 06:34:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pcCWVFSQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:34:03 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ca9a60-5bb2-4eb2-9234-c4176d37124d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:34:03 user nova-compute[74295]: No targets found.
Oct 26 06:34:03 user nova-compute[74295]: iSNS:
Oct 26 06:34:03 user nova-compute[74295]: No targets found.
Oct 26 06:34:03 user nova-compute[74295]: STATIC:
Oct 26 06:34:03 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:34:03 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:03 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:03 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5
Oct 26 06:34:03 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:03 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:03 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8
Oct 26 06:34:03 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:03 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:03 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f
Oct 26 06:34:03 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:03 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:03 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:34:03 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:03 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:03 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:34:03 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:03 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:03 user nova-compute[74295]: FIRMWARE:
Oct 26 06:34:03 user nova-compute[74295]: No targets found.
Oct 26 06:34:03 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:34:03 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:34:03 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ff6824-9e16-4a2f-9623-1df1714535cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e2358-e14c-4f81-9baa-af64c333e192]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:03 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:03 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:03 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac18a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:34:03 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c399dba4-3f16-4a5b-924d-105e6f699c9b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb70536d-7599-4350-a651-24315299eaf0]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6eea52-235e-4542-b646-10b4a93f0f6a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c34647-fceb-4312-b0d4-36ba1a9a07fe]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a167c5a-0585-49d2-8809-2a18511b8a36]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.183s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ad5cc1-0212-4f89-b887-2837a03a6078]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5, portal: 172.16.0.220,3260]
Oct 26 06:34:04 user nova-compute[74295]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5, portal: 172.16.0.220,3260] successful.
Oct 26 06:34:04 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927ba84-e82d-4502-b7de-9d9e78742ad5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cec6de-2621-4475-9bef-1f9913a3505a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.479s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] <== disconnect_volume: return (480ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:34:04 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:05 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lazy-loading 'flavor' on Instance uuid 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:34:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1073704f-cd6b-48a3-bea8-15ddb75b7817 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.097s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:05 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:05 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.volume.cinder [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Update attachment failed for attachment b1b9fb46-8efa-464f-9146-3b8caed59896. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e77b4480-de66-48f0-b106-d4a7416e40a6) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e77b4480-de66-48f0-b106-d4a7416e40a6)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Failed to connect to volume 71a685cc-8c7f-4a69-8093-282313bfb0f4 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e77b4480-de66-48f0-b106-d4a7416e40a6)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Traceback (most recent call last):
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     new_cinfo = self.volume_api.attachment_update(
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     res = method(self, ctx, *args, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     with excutils.save_and_reraise_exception():
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     self.force_reraise()
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     raise self.value
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     return method.func(obj, *args, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     resp = self._update('/attachments/%s' % id, body)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     return self.request(url, method, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc]     raise exceptions.from_response(resp, body)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e77b4480-de66-48f0-b106-d4a7416e40a6)
Oct 26 06:34:05 user nova-compute[74295]: ERROR nova.compute.manager [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] 
Oct 26 06:34:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.242s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server [None req-ffa6ac9c-38bc-4a42-a5da-c619a81e7ed6 tempest-TestVolumeSwap-1954606801 tempest-TestVolumeSwap-1954606801-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e77b4480-de66-48f0-b106-d4a7416e40a6)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7902, in swap_volume
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7900, in _do_locked_swap_volume
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7944, in _do_swap_volume
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7793, in _swap_volume
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e77b4480-de66-48f0-b106-d4a7416e40a6)
Oct 26 06:34:05 user nova-compute[74295]: ERROR oslo_messaging.rpc.server 
Oct 26 06:34:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:07 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:07 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:34:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:34:13 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:34:13 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=6990MB free_disk=25.25977325439453GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cf010631-119f-42b0-a356-a645b27e4081 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1229385f-194e-482e-ac54-ca9cc2591edd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1f13ee5-22e7-466c-a117-ae4a707ad2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 0440536c-c9ad-439e-aa26-689b945c63ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 6b441689-7c38-455d-a55e-6cd9615049cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c9208b1d-a8e2-4806-942b-e19ebbe3e3d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:34:13 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:34:14 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:34:14 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:34:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:34:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.957s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c002695d-145c-4e74-90ae-aa1133680472] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid c002695d-145c-4e74-90ae-aa1133680472 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updating instance_info_cache with network_info: [{"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:34:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbGnmozd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:34:21 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:34:21 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:34:21 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bbddd2-9af8-4755-901c-21f6ce69f803]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:34:21 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a094050-4e58-4c45-bde9-e600bfba5761]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9] added
Oct 26 06:34:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0189cfa-cbfe-499b-a5a7-10ab9327e89f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[076c8e6b-8b17-4759-9ade-235db25f6341]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XbGnmozd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XbGnmozd" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a51fec-3c07-438f-b290-7bc0e15ccb8c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XbGnmozd'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[49547c3d-eae8-48f3-8d80-7dff70d6d4e8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742e1ab-6b17-4afd-a096-b95ce04399c3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[359399df-8d29-41d2-b6a9-1d820aa18747]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9, portal: 172.16.0.220,3260]
Oct 26 06:34:21 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9, portal: 172.16.0.220,3260] successful.
Oct 26 06:34:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c2571f-13fa-4b53-b804-e60244c17d90]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb0da66-e40d-4ec8-acde-591845508d4a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:34:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[66752ce7-c965-4c6c-b933-2fb8445ab917]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:34:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:22 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:34:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbGnmozd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:34:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:34:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23732356437353061', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:34:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732356437353061', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:34:22 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'flavor' on Instance uuid d98449c4-fbe5-44cc-82d4-d5d88b28c68d {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:34:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:34:22 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:34:22 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:34:22 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:34:22 user nova-compute[74295]:   <serial>fc733cb5-132f-4e4d-8276-6c468866b1d9</serial>
Oct 26 06:34:22 user nova-compute[74295]: </disk>
Oct 26 06:34:22 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:34:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:34:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:34:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No VIF found with MAC fa:16:3e:74:13:45, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:34:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1b2c6997-78c6-47e2-9932-845b84e3c4e5 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.139s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "89e21688-5d9e-492e-90ce-bf626963e6c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:34:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:34:26 user nova-compute[74295]: INFO nova.compute.claims [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Claim successful on node user
Oct 26 06:34:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG nova.network.neutron [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:34:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:34:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG nova.policy [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a23e0e206f504aaeb7909b322ea2d563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c9296eef7f4c45b5275803942de414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:34:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Creating image(s)
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "/opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "/opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "/opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk 1073741824" returned: 0 in 0.064s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.network.neutron [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Successfully created port: 0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.318s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Cannot resize image /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Ensure instance console log exists: /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.network.neutron [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Successfully updated port: 0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "refresh_cache-89e21688-5d9e-492e-90ce-bf626963e6c5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquired lock "refresh_cache-89e21688-5d9e-492e-90ce-bf626963e6c5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.network.neutron [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-65aa9b34-96c7-487d-9f30-7b9086615cf0 req-e291aec5-90ff-4810-be7a-2bbf037619cb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received event network-changed-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-65aa9b34-96c7-487d-9f30-7b9086615cf0 req-e291aec5-90ff-4810-be7a-2bbf037619cb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Refreshing instance network info cache due to event network-changed-0feee113-0a27-403b-987a-36375e4f6394. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-65aa9b34-96c7-487d-9f30-7b9086615cf0 req-e291aec5-90ff-4810-be7a-2bbf037619cb service nova] Acquiring lock "refresh_cache-89e21688-5d9e-492e-90ce-bf626963e6c5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:34:28 user nova-compute[74295]: DEBUG nova.network.neutron [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.network.neutron [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Updating instance_info_cache with network_info: [{"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Releasing lock "refresh_cache-89e21688-5d9e-492e-90ce-bf626963e6c5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Instance network_info: |[{"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-65aa9b34-96c7-487d-9f30-7b9086615cf0 req-e291aec5-90ff-4810-be7a-2bbf037619cb service nova] Acquired lock "refresh_cache-89e21688-5d9e-492e-90ce-bf626963e6c5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.network.neutron [req-65aa9b34-96c7-487d-9f30-7b9086615cf0 req-e291aec5-90ff-4810-be7a-2bbf037619cb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Refreshing network info cache for port 0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Start _get_guest_xml network_info=[{"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:34:29 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:34:29 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1087427145',display_name='tempest-AttachVolumeNegativeTest-server-1087427145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1087427145',id=21,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkC3sE9FSBgz1PXy0mf8yrmSU8Sy1fT2WIK+5VTW5zF4HOFGW4hLp2XXtVNYfniDSaIib1L5i6prfTJ9On0GliH0ECpywyvP1TU77A7KwXElRXQZ/Qz4iXes8uBRsjmeQ==',key_name='tempest-keypair-1391080014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-crc6ay5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=89e21688-5d9e-492e-90ce-bf626963e6c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:9f,bridge_name='br-int',has_traffic_filtering=True,id=0feee113-0a27-403b-987a-36375e4f6394,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0feee113-0a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.objects.instance [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'pci_devices' on Instance uuid 89e21688-5d9e-492e-90ce-bf626963e6c5 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:34:29 user nova-compute[74295]:   <uuid>89e21688-5d9e-492e-90ce-bf626963e6c5</uuid>
Oct 26 06:34:29 user nova-compute[74295]:   <name>instance-00000015</name>
Oct 26 06:34:29 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:34:29 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:34:29 user nova-compute[74295]:   <metadata>
Oct 26 06:34:29 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:34:29 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:34:29 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1087427145</nova:name>
Oct 26 06:34:29 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:34:29</nova:creationTime>
Oct 26 06:34:29 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:34:29 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:34:29 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:34:29 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:34:29 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:34:29 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:34:29 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:34:29 user nova-compute[74295]:       <nova:owner>
Oct 26 06:34:29 user nova-compute[74295]:         <nova:user uuid="a23e0e206f504aaeb7909b322ea2d563">tempest-AttachVolumeNegativeTest-1112300090-project-member</nova:user>
Oct 26 06:34:29 user nova-compute[74295]:         <nova:project uuid="c2c9296eef7f4c45b5275803942de414">tempest-AttachVolumeNegativeTest-1112300090</nova:project>
Oct 26 06:34:29 user nova-compute[74295]:       </nova:owner>
Oct 26 06:34:29 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:34:29 user nova-compute[74295]:       <nova:ports>
Oct 26 06:34:29 user nova-compute[74295]:         <nova:port uuid="0feee113-0a27-403b-987a-36375e4f6394">
Oct 26 06:34:29 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 06:34:29 user nova-compute[74295]:         </nova:port>
Oct 26 06:34:29 user nova-compute[74295]:       </nova:ports>
Oct 26 06:34:29 user nova-compute[74295]:     </nova:instance>
Oct 26 06:34:29 user nova-compute[74295]:   </metadata>
Oct 26 06:34:29 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:34:29 user nova-compute[74295]:     <system>
Oct 26 06:34:29 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:34:29 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:34:29 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:34:29 user nova-compute[74295]:       <entry name="serial">89e21688-5d9e-492e-90ce-bf626963e6c5</entry>
Oct 26 06:34:29 user nova-compute[74295]:       <entry name="uuid">89e21688-5d9e-492e-90ce-bf626963e6c5</entry>
Oct 26 06:34:29 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:34:29 user nova-compute[74295]:     </system>
Oct 26 06:34:29 user nova-compute[74295]:   </sysinfo>
Oct 26 06:34:29 user nova-compute[74295]:   <os>
Oct 26 06:34:29 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:34:29 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:34:29 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:34:29 user nova-compute[74295]:   </os>
Oct 26 06:34:29 user nova-compute[74295]:   <features>
Oct 26 06:34:29 user nova-compute[74295]:     <acpi/>
Oct 26 06:34:29 user nova-compute[74295]:     <apic/>
Oct 26 06:34:29 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:34:29 user nova-compute[74295]:   </features>
Oct 26 06:34:29 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:34:29 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:34:29 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:34:29 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:34:29 user nova-compute[74295]:   </clock>
Oct 26 06:34:29 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:34:29 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:34:29 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:34:29 user nova-compute[74295]:   </cpu>
Oct 26 06:34:29 user nova-compute[74295]:   <devices>
Oct 26 06:34:29 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:34:29 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:34:29 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk"/>
Oct 26 06:34:29 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:34:29 user nova-compute[74295]:     </disk>
Oct 26 06:34:29 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:34:29 user nova-compute[74295]:       <mac address="fa:16:3e:b8:31:9f"/>
Oct 26 06:34:29 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:34:29 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:34:29 user nova-compute[74295]:       <target dev="tap0feee113-0a"/>
Oct 26 06:34:29 user nova-compute[74295]:     </interface>
Oct 26 06:34:29 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:34:29 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/console.log" append="off"/>
Oct 26 06:34:29 user nova-compute[74295]:     </serial>
Oct 26 06:34:29 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:34:29 user nova-compute[74295]:     <video>
Oct 26 06:34:29 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:34:29 user nova-compute[74295]:     </video>
Oct 26 06:34:29 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:34:29 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:34:29 user nova-compute[74295]:     </rng>
Oct 26 06:34:29 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:34:29 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:34:29 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:34:29 user nova-compute[74295]:     </memballoon>
Oct 26 06:34:29 user nova-compute[74295]:   </devices>
Oct 26 06:34:29 user nova-compute[74295]: </domain>
Oct 26 06:34:29 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1087427145',display_name='tempest-AttachVolumeNegativeTest-server-1087427145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1087427145',id=21,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkC3sE9FSBgz1PXy0mf8yrmSU8Sy1fT2WIK+5VTW5zF4HOFGW4hLp2XXtVNYfniDSaIib1L5i6prfTJ9On0GliH0ECpywyvP1TU77A7KwXElRXQZ/Qz4iXes8uBRsjmeQ==',key_name='tempest-keypair-1391080014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-crc6ay5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=89e21688-5d9e-492e-90ce-bf626963e6c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:9f,bridge_name='br-int',has_traffic_filtering=True,id=0feee113-0a27-403b-987a-36375e4f6394,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0feee113-0a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG os_vif [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:9f,bridge_name='br-int',has_traffic_filtering=True,id=0feee113-0a27-403b-987a-36375e4f6394,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0feee113-0a') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0392486-e2d8-5081-84d2-0d4b25a66fd7', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0feee113-0a, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0feee113-0a, col_values=(('qos', UUID('82dd5361-80ef-4603-b275-29f56ebf2657')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0feee113-0a, col_values=(('external_ids', {'iface-id': '0feee113-0a27-403b-987a-36375e4f6394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:31:9f', 'vm-uuid': '89e21688-5d9e-492e-90ce-bf626963e6c5'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:29 user nova-compute[74295]: INFO os_vif [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:9f,bridge_name='br-int',has_traffic_filtering=True,id=0feee113-0a27-403b-987a-36375e4f6394,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0feee113-0a')
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No VIF found with MAC fa:16:3e:b8:31:9f, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.network.neutron [req-65aa9b34-96c7-487d-9f30-7b9086615cf0 req-e291aec5-90ff-4810-be7a-2bbf037619cb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Updated VIF entry in instance network info cache for port 0feee113-0a27-403b-987a-36375e4f6394. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG nova.network.neutron [req-65aa9b34-96c7-487d-9f30-7b9086615cf0 req-e291aec5-90ff-4810-be7a-2bbf037619cb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Updating instance_info_cache with network_info: [{"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:34:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-65aa9b34-96c7-487d-9f30-7b9086615cf0 req-e291aec5-90ff-4810-be7a-2bbf037619cb service nova] Releasing lock "refresh_cache-89e21688-5d9e-492e-90ce-bf626963e6c5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:34:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-357e821e-5a42-4ef1-8384-9f3fbba0441a req-10a9f229-3e1e-4f0c-a12b-7cce43e61d84 service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received event network-vif-plugged-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-357e821e-5a42-4ef1-8384-9f3fbba0441a req-10a9f229-3e1e-4f0c-a12b-7cce43e61d84 service nova] Acquiring lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-357e821e-5a42-4ef1-8384-9f3fbba0441a req-10a9f229-3e1e-4f0c-a12b-7cce43e61d84 service nova] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-357e821e-5a42-4ef1-8384-9f3fbba0441a req-10a9f229-3e1e-4f0c-a12b-7cce43e61d84 service nova] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-357e821e-5a42-4ef1-8384-9f3fbba0441a req-10a9f229-3e1e-4f0c-a12b-7cce43e61d84 service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] No waiting events found dispatching network-vif-plugged-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:30 user nova-compute[74295]: WARNING nova.compute.manager [req-357e821e-5a42-4ef1-8384-9f3fbba0441a req-10a9f229-3e1e-4f0c-a12b-7cce43e61d84 service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received unexpected event network-vif-plugged-0feee113-0a27-403b-987a-36375e4f6394 for instance with vm_state building and task_state spawning.
Oct 26 06:34:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:34:32 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Instance spawned successfully.
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-7e8c0a82-8d27-43ce-8b8d-d1a99995702b req-814c2ce0-c7e5-4353-9992-7bac09d7add3 service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received event network-vif-plugged-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7e8c0a82-8d27-43ce-8b8d-d1a99995702b req-814c2ce0-c7e5-4353-9992-7bac09d7add3 service nova] Acquiring lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7e8c0a82-8d27-43ce-8b8d-d1a99995702b req-814c2ce0-c7e5-4353-9992-7bac09d7add3 service nova] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7e8c0a82-8d27-43ce-8b8d-d1a99995702b req-814c2ce0-c7e5-4353-9992-7bac09d7add3 service nova] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-7e8c0a82-8d27-43ce-8b8d-d1a99995702b req-814c2ce0-c7e5-4353-9992-7bac09d7add3 service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] No waiting events found dispatching network-vif-plugged-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:32 user nova-compute[74295]: WARNING nova.compute.manager [req-7e8c0a82-8d27-43ce-8b8d-d1a99995702b req-814c2ce0-c7e5-4353-9992-7bac09d7add3 service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received unexpected event network-vif-plugged-0feee113-0a27-403b-987a-36375e4f6394 for instance with vm_state building and task_state spawning.
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:32 user nova-compute[74295]: INFO nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 26 06:34:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:34:33 user nova-compute[74295]: INFO nova.compute.manager [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Took 6.56 seconds to build instance.
Oct 26 06:34:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-49f574bb-ea85-4aba-b375-2666d0491c99 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.676s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:33 user nova-compute[74295]: INFO nova.compute.manager [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Terminating instance
Oct 26 06:34:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-20cb6f24-9393-496f-8a36-f384b3bf32b6 req-54fb9368-b1f6-489f-8c9c-eaeae3566f3b service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received event network-vif-unplugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-20cb6f24-9393-496f-8a36-f384b3bf32b6 req-54fb9368-b1f6-489f-8c9c-eaeae3566f3b service nova] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-20cb6f24-9393-496f-8a36-f384b3bf32b6 req-54fb9368-b1f6-489f-8c9c-eaeae3566f3b service nova] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-20cb6f24-9393-496f-8a36-f384b3bf32b6 req-54fb9368-b1f6-489f-8c9c-eaeae3566f3b service nova] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-20cb6f24-9393-496f-8a36-f384b3bf32b6 req-54fb9368-b1f6-489f-8c9c-eaeae3566f3b service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] No waiting events found dispatching network-vif-unplugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-20cb6f24-9393-496f-8a36-f384b3bf32b6 req-54fb9368-b1f6-489f-8c9c-eaeae3566f3b service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received event network-vif-unplugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Instance destroyed successfully.
Oct 26 06:34:34 user nova-compute[74295]: DEBUG nova.objects.instance [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lazy-loading 'resources' on Instance uuid 1229385f-194e-482e-ac54-ca9cc2591edd {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-812741977',display_name='tempest-TestServerVolumeAttachmentScenario-server-812741977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-812741977',id=15,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNCHQll3vU578k7buY5N87dR8esbbI8tbMM76gVYJ8dnm2CmKZ2TG/5sZsc71b77d5Lq36TaBdJPnHSchG5/A9mXcp6up26ThX4ekGLofibsgNS8RdJ4F4OUpYXzKqx1w==',key_name='tempest-keypair-635302849',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:30:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6b81f5ea6494b28bae66e491d00224a',ramdisk_id='',reservation_id='r-qv4zkapp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2131838263',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2131838263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52ce37b4013c423ab2b3ee18de59268d',uuid=1229385f-194e-482e-ac54-ca9cc2591edd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Converting VIF {"id": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "address": "fa:16:3e:0d:eb:54", "network": {"id": "2e14910d-21e1-4734-b4ad-04167d93510c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-179989607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6b81f5ea6494b28bae66e491d00224a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc3fa6ad-78", "ovs_interfaceid": "fc3fa6ad-7873-40a2-98cb-0732397e2450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:eb:54,bridge_name='br-int',has_traffic_filtering=True,id=fc3fa6ad-7873-40a2-98cb-0732397e2450,network=Network(2e14910d-21e1-4734-b4ad-04167d93510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3fa6ad-78') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG os_vif [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:eb:54,bridge_name='br-int',has_traffic_filtering=True,id=fc3fa6ad-7873-40a2-98cb-0732397e2450,network=Network(2e14910d-21e1-4734-b4ad-04167d93510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3fa6ad-78') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc3fa6ad-78, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d50854c-3d05-4c04-948d-dce19772d2f1) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:34 user nova-compute[74295]: INFO os_vif [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:eb:54,bridge_name='br-int',has_traffic_filtering=True,id=fc3fa6ad-7873-40a2-98cb-0732397e2450,network=Network(2e14910d-21e1-4734-b4ad-04167d93510c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc3fa6ad-78')
Oct 26 06:34:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Deleting instance files /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd_del
Oct 26 06:34:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Deletion of /opt/stack/data/nova/instances/1229385f-194e-482e-ac54-ca9cc2591edd_del complete
Oct 26 06:34:34 user nova-compute[74295]: INFO nova.compute.manager [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 26 06:34:34 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:34:34 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:34:35 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:34:35 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Took 0.90 seconds to deallocate network for instance.
Oct 26 06:34:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:36 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:34:36 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:34:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-437246f1-5c69-41da-a0ed-fd1d5cfa8809 req-624a1a0e-fcb7-430a-af23-f6b888a01b7e service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received event network-vif-plugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-437246f1-5c69-41da-a0ed-fd1d5cfa8809 req-624a1a0e-fcb7-430a-af23-f6b888a01b7e service nova] Acquiring lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-437246f1-5c69-41da-a0ed-fd1d5cfa8809 req-624a1a0e-fcb7-430a-af23-f6b888a01b7e service nova] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-437246f1-5c69-41da-a0ed-fd1d5cfa8809 req-624a1a0e-fcb7-430a-af23-f6b888a01b7e service nova] Lock "1229385f-194e-482e-ac54-ca9cc2591edd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-437246f1-5c69-41da-a0ed-fd1d5cfa8809 req-624a1a0e-fcb7-430a-af23-f6b888a01b7e service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] No waiting events found dispatching network-vif-plugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:36 user nova-compute[74295]: WARNING nova.compute.manager [req-437246f1-5c69-41da-a0ed-fd1d5cfa8809 req-624a1a0e-fcb7-430a-af23-f6b888a01b7e service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received unexpected event network-vif-plugged-fc3fa6ad-7873-40a2-98cb-0732397e2450 for instance with vm_state deleted and task_state None.
Oct 26 06:34:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-437246f1-5c69-41da-a0ed-fd1d5cfa8809 req-624a1a0e-fcb7-430a-af23-f6b888a01b7e service nova] [instance: 1229385f-194e-482e-ac54-ca9cc2591edd] Received event network-vif-deleted-fc3fa6ad-7873-40a2-98cb-0732397e2450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:36 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Deleted allocations for instance 1229385f-194e-482e-ac54-ca9cc2591edd
Oct 26 06:34:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a7e4c6df-556c-4034-9f89-d2375567cd43 tempest-TestServerVolumeAttachmentScenario-2131838263 tempest-TestServerVolumeAttachmentScenario-2131838263-project-member] Lock "1229385f-194e-482e-ac54-ca9cc2591edd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.542s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "331e2afa-bf70-421f-b26d-ee3067d8aa64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:34:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:42 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:34:42 user nova-compute[74295]: INFO nova.compute.claims [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Claim successful on node user
Oct 26 06:34:42 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:34:43 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:34:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG nova.policy [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '969b88effa7b4c14a9fdca34760804e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac89a741e94482bf18b56aca6a53c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:34:43 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Creating image(s)
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "/opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "/opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "/opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.200s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk 1073741824" returned: 0 in 0.057s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Cannot resize image /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Ensure instance console log exists: /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Successfully created port: f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:34:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Successfully updated port: f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "refresh_cache-331e2afa-bf70-421f-b26d-ee3067d8aa64" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquired lock "refresh_cache-331e2afa-bf70-421f-b26d-ee3067d8aa64" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-b1ee962e-0777-4cf2-a18c-5d6b7c163928 req-128a8ce7-ea0d-4a20-90a2-9a0cc0c478a1 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received event network-changed-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-b1ee962e-0777-4cf2-a18c-5d6b7c163928 req-128a8ce7-ea0d-4a20-90a2-9a0cc0c478a1 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Refreshing instance network info cache due to event network-changed-f9524efd-4af4-4292-98a1-4ca88442d6b4. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b1ee962e-0777-4cf2-a18c-5d6b7c163928 req-128a8ce7-ea0d-4a20-90a2-9a0cc0c478a1 service nova] Acquiring lock "refresh_cache-331e2afa-bf70-421f-b26d-ee3067d8aa64" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Updating instance_info_cache with network_info: [{"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Releasing lock "refresh_cache-331e2afa-bf70-421f-b26d-ee3067d8aa64" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Instance network_info: |[{"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b1ee962e-0777-4cf2-a18c-5d6b7c163928 req-128a8ce7-ea0d-4a20-90a2-9a0cc0c478a1 service nova] Acquired lock "refresh_cache-331e2afa-bf70-421f-b26d-ee3067d8aa64" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.network.neutron [req-b1ee962e-0777-4cf2-a18c-5d6b7c163928 req-128a8ce7-ea0d-4a20-90a2-9a0cc0c478a1 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Refreshing network info cache for port f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Start _get_guest_xml network_info=[{"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:34:45 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:34:45 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-875242491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-875242491',id=22,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-eyq0j1el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:43Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=331e2afa-bf70-421f-b26d-ee3067d8aa64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=f9524efd-4af4-4292-98a1-4ca88442d6b4,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9524efd-4a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'pci_devices' on Instance uuid 331e2afa-bf70-421f-b26d-ee3067d8aa64 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:34:45 user nova-compute[74295]:   <uuid>331e2afa-bf70-421f-b26d-ee3067d8aa64</uuid>
Oct 26 06:34:45 user nova-compute[74295]:   <name>instance-00000016</name>
Oct 26 06:34:45 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:34:45 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:34:45 user nova-compute[74295]:   <metadata>
Oct 26 06:34:45 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:34:45 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:34:45 user nova-compute[74295]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-875242491</nova:name>
Oct 26 06:34:45 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:34:45</nova:creationTime>
Oct 26 06:34:45 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:34:45 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:34:45 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:34:45 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:34:45 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:34:45 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:34:45 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:34:45 user nova-compute[74295]:       <nova:owner>
Oct 26 06:34:45 user nova-compute[74295]:         <nova:user uuid="969b88effa7b4c14a9fdca34760804e8">tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member</nova:user>
Oct 26 06:34:45 user nova-compute[74295]:         <nova:project uuid="e0ac89a741e94482bf18b56aca6a53c1">tempest-ServerBootFromVolumeStableRescueTest-1259261992</nova:project>
Oct 26 06:34:45 user nova-compute[74295]:       </nova:owner>
Oct 26 06:34:45 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:34:45 user nova-compute[74295]:       <nova:ports>
Oct 26 06:34:45 user nova-compute[74295]:         <nova:port uuid="f9524efd-4af4-4292-98a1-4ca88442d6b4">
Oct 26 06:34:45 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:34:45 user nova-compute[74295]:         </nova:port>
Oct 26 06:34:45 user nova-compute[74295]:       </nova:ports>
Oct 26 06:34:45 user nova-compute[74295]:     </nova:instance>
Oct 26 06:34:45 user nova-compute[74295]:   </metadata>
Oct 26 06:34:45 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:34:45 user nova-compute[74295]:     <system>
Oct 26 06:34:45 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:34:45 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:34:45 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:34:45 user nova-compute[74295]:       <entry name="serial">331e2afa-bf70-421f-b26d-ee3067d8aa64</entry>
Oct 26 06:34:45 user nova-compute[74295]:       <entry name="uuid">331e2afa-bf70-421f-b26d-ee3067d8aa64</entry>
Oct 26 06:34:45 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:34:45 user nova-compute[74295]:     </system>
Oct 26 06:34:45 user nova-compute[74295]:   </sysinfo>
Oct 26 06:34:45 user nova-compute[74295]:   <os>
Oct 26 06:34:45 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:34:45 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:34:45 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:34:45 user nova-compute[74295]:   </os>
Oct 26 06:34:45 user nova-compute[74295]:   <features>
Oct 26 06:34:45 user nova-compute[74295]:     <acpi/>
Oct 26 06:34:45 user nova-compute[74295]:     <apic/>
Oct 26 06:34:45 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:34:45 user nova-compute[74295]:   </features>
Oct 26 06:34:45 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:34:45 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:34:45 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:34:45 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:34:45 user nova-compute[74295]:   </clock>
Oct 26 06:34:45 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:34:45 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:34:45 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:34:45 user nova-compute[74295]:   </cpu>
Oct 26 06:34:45 user nova-compute[74295]:   <devices>
Oct 26 06:34:45 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:34:45 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:34:45 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk"/>
Oct 26 06:34:45 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:34:45 user nova-compute[74295]:     </disk>
Oct 26 06:34:45 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:34:45 user nova-compute[74295]:       <mac address="fa:16:3e:82:7a:7b"/>
Oct 26 06:34:45 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:34:45 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:34:45 user nova-compute[74295]:       <target dev="tapf9524efd-4a"/>
Oct 26 06:34:45 user nova-compute[74295]:     </interface>
Oct 26 06:34:45 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:34:45 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/console.log" append="off"/>
Oct 26 06:34:45 user nova-compute[74295]:     </serial>
Oct 26 06:34:45 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:34:45 user nova-compute[74295]:     <video>
Oct 26 06:34:45 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:34:45 user nova-compute[74295]:     </video>
Oct 26 06:34:45 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:34:45 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:34:45 user nova-compute[74295]:     </rng>
Oct 26 06:34:45 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:34:45 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:34:45 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:34:45 user nova-compute[74295]:     </memballoon>
Oct 26 06:34:45 user nova-compute[74295]:   </devices>
Oct 26 06:34:45 user nova-compute[74295]: </domain>
Oct 26 06:34:45 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-875242491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-875242491',id=22,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-eyq0j1el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:43Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=331e2afa-bf70-421f-b26d-ee3067d8aa64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=f9524efd-4af4-4292-98a1-4ca88442d6b4,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9524efd-4a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG os_vif [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=f9524efd-4af4-4292-98a1-4ca88442d6b4,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9524efd-4a') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4a19947-4c47-55a3-822b-f1447d10ffd1', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9524efd-4a, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9524efd-4a, col_values=(('qos', UUID('60560c2a-a799-4dca-a4ab-6b4ca0d31bba')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9524efd-4a, col_values=(('external_ids', {'iface-id': 'f9524efd-4af4-4292-98a1-4ca88442d6b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:7a:7b', 'vm-uuid': '331e2afa-bf70-421f-b26d-ee3067d8aa64'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:45 user nova-compute[74295]: INFO os_vif [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=f9524efd-4af4-4292-98a1-4ca88442d6b4,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9524efd-4a')
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:34:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No VIF found with MAC fa:16:3e:82:7a:7b, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:34:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-b1ee962e-0777-4cf2-a18c-5d6b7c163928 req-128a8ce7-ea0d-4a20-90a2-9a0cc0c478a1 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Updated VIF entry in instance network info cache for port f9524efd-4af4-4292-98a1-4ca88442d6b4. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:34:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-b1ee962e-0777-4cf2-a18c-5d6b7c163928 req-128a8ce7-ea0d-4a20-90a2-9a0cc0c478a1 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Updating instance_info_cache with network_info: [{"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:34:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b1ee962e-0777-4cf2-a18c-5d6b7c163928 req-128a8ce7-ea0d-4a20-90a2-9a0cc0c478a1 service nova] Releasing lock "refresh_cache-331e2afa-bf70-421f-b26d-ee3067d8aa64" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:34:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-4c43a57b-c837-48d6-91b4-4df64e1100a1 req-f3ed4867-5ba4-47ce-adfa-44a58451d3cf service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received event network-vif-plugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4c43a57b-c837-48d6-91b4-4df64e1100a1 req-f3ed4867-5ba4-47ce-adfa-44a58451d3cf service nova] Acquiring lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4c43a57b-c837-48d6-91b4-4df64e1100a1 req-f3ed4867-5ba4-47ce-adfa-44a58451d3cf service nova] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4c43a57b-c837-48d6-91b4-4df64e1100a1 req-f3ed4867-5ba4-47ce-adfa-44a58451d3cf service nova] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-4c43a57b-c837-48d6-91b4-4df64e1100a1 req-f3ed4867-5ba4-47ce-adfa-44a58451d3cf service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] No waiting events found dispatching network-vif-plugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:47 user nova-compute[74295]: WARNING nova.compute.manager [req-4c43a57b-c837-48d6-91b4-4df64e1100a1 req-f3ed4867-5ba4-47ce-adfa-44a58451d3cf service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received unexpected event network-vif-plugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 for instance with vm_state building and task_state spawning.
Oct 26 06:34:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:34:48 user nova-compute[74295]: INFO nova.compute.claims [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Claim successful on node user
Oct 26 06:34:48 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:34:48 user nova-compute[74295]: DEBUG nova.network.neutron [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:34:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.policy [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b0e86cf3ec049a58aee69c427717598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c33a42f4b946d28de9e355927737e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:34:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Creating image(s)
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-f5a1016e-e0a1-425e-b1ef-dfba60b6ae43 req-900f8f36-fc5f-4360-856b-da1d0d2b1d61 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received event network-vif-plugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f5a1016e-e0a1-425e-b1ef-dfba60b6ae43 req-900f8f36-fc5f-4360-856b-da1d0d2b1d61 service nova] Acquiring lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f5a1016e-e0a1-425e-b1ef-dfba60b6ae43 req-900f8f36-fc5f-4360-856b-da1d0d2b1d61 service nova] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f5a1016e-e0a1-425e-b1ef-dfba60b6ae43 req-900f8f36-fc5f-4360-856b-da1d0d2b1d61 service nova] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-f5a1016e-e0a1-425e-b1ef-dfba60b6ae43 req-900f8f36-fc5f-4360-856b-da1d0d2b1d61 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] No waiting events found dispatching network-vif-plugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:49 user nova-compute[74295]: WARNING nova.compute.manager [req-f5a1016e-e0a1-425e-b1ef-dfba60b6ae43 req-900f8f36-fc5f-4360-856b-da1d0d2b1d61 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received unexpected event network-vif-plugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 for instance with vm_state building and task_state spawning.
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.228s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:34:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Instance spawned successfully.
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.237s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:49 user nova-compute[74295]: INFO nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Took 6.44 seconds to spawn the instance on the hypervisor.
Oct 26 06:34:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk 1073741824" returned: 0 in 0.073s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.223s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:50 user nova-compute[74295]: INFO nova.compute.manager [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Took 7.75 seconds to build instance.
Oct 26 06:34:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1ca2aaa3-5197-4912-8a64-db619ca7946e tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.880s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Cannot resize image /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Ensure instance console log exists: /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Successfully created port: 775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:34:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Successfully updated port: 775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquired lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updating instance_info_cache with network_info: [{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Releasing lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Instance network_info: |[{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Start _get_guest_xml network_info=[{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:34:51 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:34:51 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1292363646',display_name='tempest-ServerRescueNegativeTestJSON-server-1292363646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1292363646',id=23,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsTZlJheNp8sVuhOrIqG8qdNLOjdx64RyRTKV9E6RNWLg7CAdzx3HBr741A9mhH3N1E6pyKCeBiyizgQdHyyg0KibIFZPr7FeQmHvdsblnqk/03y+0vGoXBplYR2DLKNA==',key_name='tempest-keypair-61692672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-c6l7dwko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b0e86cf3ec049a58aee69c427717598',uuid=d6c25b84-4b35-4086-89a5-d5f2823b507a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3f:72,bridge_name='br-int',has_traffic_filtering=True,id=775a3f05-426c-473c-a0ce-499522370ef9,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775a3f05-42') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.objects.instance [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'pci_devices' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-41c78939-8618-4d46-bcf2-99cff150bed9 req-2d2e05f8-6bb1-4ab8-8e70-9a1cb4ad1b19 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-changed-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-41c78939-8618-4d46-bcf2-99cff150bed9 req-2d2e05f8-6bb1-4ab8-8e70-9a1cb4ad1b19 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Refreshing instance network info cache due to event network-changed-775a3f05-426c-473c-a0ce-499522370ef9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-41c78939-8618-4d46-bcf2-99cff150bed9 req-2d2e05f8-6bb1-4ab8-8e70-9a1cb4ad1b19 service nova] Acquiring lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-41c78939-8618-4d46-bcf2-99cff150bed9 req-2d2e05f8-6bb1-4ab8-8e70-9a1cb4ad1b19 service nova] Acquired lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.network.neutron [req-41c78939-8618-4d46-bcf2-99cff150bed9 req-2d2e05f8-6bb1-4ab8-8e70-9a1cb4ad1b19 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Refreshing network info cache for port 775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:34:51 user nova-compute[74295]:   <uuid>d6c25b84-4b35-4086-89a5-d5f2823b507a</uuid>
Oct 26 06:34:51 user nova-compute[74295]:   <name>instance-00000017</name>
Oct 26 06:34:51 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:34:51 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:34:51 user nova-compute[74295]:   <metadata>
Oct 26 06:34:51 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:34:51 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:34:51 user nova-compute[74295]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1292363646</nova:name>
Oct 26 06:34:51 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:34:51</nova:creationTime>
Oct 26 06:34:51 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:34:51 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:34:51 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:34:51 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:34:51 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:34:51 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:34:51 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:34:51 user nova-compute[74295]:       <nova:owner>
Oct 26 06:34:51 user nova-compute[74295]:         <nova:user uuid="3b0e86cf3ec049a58aee69c427717598">tempest-ServerRescueNegativeTestJSON-1373728584-project-member</nova:user>
Oct 26 06:34:51 user nova-compute[74295]:         <nova:project uuid="65c33a42f4b946d28de9e355927737e8">tempest-ServerRescueNegativeTestJSON-1373728584</nova:project>
Oct 26 06:34:51 user nova-compute[74295]:       </nova:owner>
Oct 26 06:34:51 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:34:51 user nova-compute[74295]:       <nova:ports>
Oct 26 06:34:51 user nova-compute[74295]:         <nova:port uuid="775a3f05-426c-473c-a0ce-499522370ef9">
Oct 26 06:34:51 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 06:34:51 user nova-compute[74295]:         </nova:port>
Oct 26 06:34:51 user nova-compute[74295]:       </nova:ports>
Oct 26 06:34:51 user nova-compute[74295]:     </nova:instance>
Oct 26 06:34:51 user nova-compute[74295]:   </metadata>
Oct 26 06:34:51 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:34:51 user nova-compute[74295]:     <system>
Oct 26 06:34:51 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:34:51 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:34:51 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:34:51 user nova-compute[74295]:       <entry name="serial">d6c25b84-4b35-4086-89a5-d5f2823b507a</entry>
Oct 26 06:34:51 user nova-compute[74295]:       <entry name="uuid">d6c25b84-4b35-4086-89a5-d5f2823b507a</entry>
Oct 26 06:34:51 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:34:51 user nova-compute[74295]:     </system>
Oct 26 06:34:51 user nova-compute[74295]:   </sysinfo>
Oct 26 06:34:51 user nova-compute[74295]:   <os>
Oct 26 06:34:51 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:34:51 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:34:51 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:34:51 user nova-compute[74295]:   </os>
Oct 26 06:34:51 user nova-compute[74295]:   <features>
Oct 26 06:34:51 user nova-compute[74295]:     <acpi/>
Oct 26 06:34:51 user nova-compute[74295]:     <apic/>
Oct 26 06:34:51 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:34:51 user nova-compute[74295]:   </features>
Oct 26 06:34:51 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:34:51 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:34:51 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:34:51 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:34:51 user nova-compute[74295]:   </clock>
Oct 26 06:34:51 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:34:51 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:34:51 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:34:51 user nova-compute[74295]:   </cpu>
Oct 26 06:34:51 user nova-compute[74295]:   <devices>
Oct 26 06:34:51 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:34:51 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:34:51 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk"/>
Oct 26 06:34:51 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:34:51 user nova-compute[74295]:     </disk>
Oct 26 06:34:51 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:34:51 user nova-compute[74295]:       <mac address="fa:16:3e:a1:3f:72"/>
Oct 26 06:34:51 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:34:51 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:34:51 user nova-compute[74295]:       <target dev="tap775a3f05-42"/>
Oct 26 06:34:51 user nova-compute[74295]:     </interface>
Oct 26 06:34:51 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:34:51 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/console.log" append="off"/>
Oct 26 06:34:51 user nova-compute[74295]:     </serial>
Oct 26 06:34:51 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:34:51 user nova-compute[74295]:     <video>
Oct 26 06:34:51 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:34:51 user nova-compute[74295]:     </video>
Oct 26 06:34:51 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:34:51 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:34:51 user nova-compute[74295]:     </rng>
Oct 26 06:34:51 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:34:51 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:34:51 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:34:51 user nova-compute[74295]:     </memballoon>
Oct 26 06:34:51 user nova-compute[74295]:   </devices>
Oct 26 06:34:51 user nova-compute[74295]: </domain>
Oct 26 06:34:51 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1292363646',display_name='tempest-ServerRescueNegativeTestJSON-server-1292363646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1292363646',id=23,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsTZlJheNp8sVuhOrIqG8qdNLOjdx64RyRTKV9E6RNWLg7CAdzx3HBr741A9mhH3N1E6pyKCeBiyizgQdHyyg0KibIFZPr7FeQmHvdsblnqk/03y+0vGoXBplYR2DLKNA==',key_name='tempest-keypair-61692672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-c6l7dwko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b0e86cf3ec049a58aee69c427717598',uuid=d6c25b84-4b35-4086-89a5-d5f2823b507a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3f:72,bridge_name='br-int',has_traffic_filtering=True,id=775a3f05-426c-473c-a0ce-499522370ef9,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775a3f05-42') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG os_vif [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3f:72,bridge_name='br-int',has_traffic_filtering=True,id=775a3f05-426c-473c-a0ce-499522370ef9,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775a3f05-42') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '270405fb-bbef-5833-840d-0ff9762ab37b', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap775a3f05-42, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap775a3f05-42, col_values=(('qos', UUID('060e1a03-3afb-4413-b469-d5fd99870079')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap775a3f05-42, col_values=(('external_ids', {'iface-id': '775a3f05-426c-473c-a0ce-499522370ef9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:3f:72', 'vm-uuid': 'd6c25b84-4b35-4086-89a5-d5f2823b507a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:51 user nova-compute[74295]: INFO os_vif [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3f:72,bridge_name='br-int',has_traffic_filtering=True,id=775a3f05-426c-473c-a0ce-499522370ef9,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775a3f05-42')
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No VIF found with MAC fa:16:3e:a1:3f:72, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:34:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-41c78939-8618-4d46-bcf2-99cff150bed9 req-2d2e05f8-6bb1-4ab8-8e70-9a1cb4ad1b19 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updated VIF entry in instance network info cache for port 775a3f05-426c-473c-a0ce-499522370ef9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:34:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-41c78939-8618-4d46-bcf2-99cff150bed9 req-2d2e05f8-6bb1-4ab8-8e70-9a1cb4ad1b19 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updating instance_info_cache with network_info: [{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:34:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-41c78939-8618-4d46-bcf2-99cff150bed9 req-2d2e05f8-6bb1-4ab8-8e70-9a1cb4ad1b19 service nova] Releasing lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:34:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "5610d9b7-e38f-450b-b395-480c4131f1be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:34:53 user nova-compute[74295]: INFO nova.compute.claims [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Claim successful on node user
Oct 26 06:34:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b417fe9-cff5-4f47-aa36-e370fe3e7bed req-06e139cc-5d8e-4a55-9edf-bc4e33d44d7f service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b417fe9-cff5-4f47-aa36-e370fe3e7bed req-06e139cc-5d8e-4a55-9edf-bc4e33d44d7f service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b417fe9-cff5-4f47-aa36-e370fe3e7bed req-06e139cc-5d8e-4a55-9edf-bc4e33d44d7f service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b417fe9-cff5-4f47-aa36-e370fe3e7bed req-06e139cc-5d8e-4a55-9edf-bc4e33d44d7f service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b417fe9-cff5-4f47-aa36-e370fe3e7bed req-06e139cc-5d8e-4a55-9edf-bc4e33d44d7f service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:53 user nova-compute[74295]: WARNING nova.compute.manager [req-9b417fe9-cff5-4f47-aa36-e370fe3e7bed req-06e139cc-5d8e-4a55-9edf-bc4e33d44d7f service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state building and task_state spawning.
Oct 26 06:34:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:34:53 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.878s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:34:54 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:34:54 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG nova.policy [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c43eade49dbf406587ea5ecd09ed131f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b106eb404d4fb7a1f869d6228ff48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:34:54 user nova-compute[74295]: INFO nova.virt.block_device [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Booting with volume 66d0f33c-55a7-4dfc-86d0-4c99085b9bda at /dev/vda
Oct 26 06:34:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-34fcb57b-c5fb-450e-823c-f68f447f844a req-3e366f6c-bd2b-4e11-b3a3-406716a991f8 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-changed-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-34fcb57b-c5fb-450e-823c-f68f447f844a req-3e366f6c-bd2b-4e11-b3a3-406716a991f8 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Refreshing instance network info cache due to event network-changed-16d2b3ee-0200-4890-918e-3caddf53dcaa. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-34fcb57b-c5fb-450e-823c-f68f447f844a req-3e366f6c-bd2b-4e11-b3a3-406716a991f8 service nova] Acquiring lock "refresh_cache-6b441689-7c38-455d-a55e-6cd9615049cf" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-34fcb57b-c5fb-450e-823c-f68f447f844a req-3e366f6c-bd2b-4e11-b3a3-406716a991f8 service nova] Acquired lock "refresh_cache-6b441689-7c38-455d-a55e-6cd9615049cf" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG nova.network.neutron [req-34fcb57b-c5fb-450e-823c-f68f447f844a req-3e366f6c-bd2b-4e11-b3a3-406716a991f8 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Refreshing network info cache for port 16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG os_brick.utils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[88793470-2932-460d-9aa2-b386bdd3dd9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a51430f-1701-4a47-8104-d72dd0379519]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ee026d-ad2d-4b61-9af3-144a61f98bcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[863e3276-9c7e-487d-bafd-14e57ea4dde9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:34:54 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:34:54 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af668fe-250a-4f5d-b551-101ccec7ea71]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG os_brick.utils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:34:54 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating existing volume attachment record: 3aeb2e6d-f200-41c5-b872-98a73db5a0a6 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:34:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-34fcb57b-c5fb-450e-823c-f68f447f844a req-3e366f6c-bd2b-4e11-b3a3-406716a991f8 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Updated VIF entry in instance network info cache for port 16d2b3ee-0200-4890-918e-3caddf53dcaa. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:34:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-34fcb57b-c5fb-450e-823c-f68f447f844a req-3e366f6c-bd2b-4e11-b3a3-406716a991f8 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Updating instance_info_cache with network_info: [{"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:34:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-34fcb57b-c5fb-450e-823c-f68f447f844a req-3e366f6c-bd2b-4e11-b3a3-406716a991f8 service nova] Releasing lock "refresh_cache-6b441689-7c38-455d-a55e-6cd9615049cf" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:34:55 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully created port: 867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:34:55 user nova-compute[74295]: INFO nova.compute.manager [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Rebuilding instance
Oct 26 06:34:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-266b7809-7ec9-4e18-9cd9-c9a635bcbb94 req-e0968ccc-31f8-4913-ac59-2120ef847f12 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-266b7809-7ec9-4e18-9cd9-c9a635bcbb94 req-e0968ccc-31f8-4913-ac59-2120ef847f12 service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-266b7809-7ec9-4e18-9cd9-c9a635bcbb94 req-e0968ccc-31f8-4913-ac59-2120ef847f12 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-266b7809-7ec9-4e18-9cd9-c9a635bcbb94 req-e0968ccc-31f8-4913-ac59-2120ef847f12 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-266b7809-7ec9-4e18-9cd9-c9a635bcbb94 req-e0968ccc-31f8-4913-ac59-2120ef847f12 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:55 user nova-compute[74295]: WARNING nova.compute.manager [req-266b7809-7ec9-4e18-9cd9-c9a635bcbb94 req-e0968ccc-31f8-4913-ac59-2120ef847f12 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state building and task_state spawning.
Oct 26 06:34:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:34:55 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully created port: 72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:56 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Instance spawned successfully.
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:56 user nova-compute[74295]: INFO nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Took 7.00 seconds to spawn the instance on the hypervisor.
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:34:56 user nova-compute[74295]: INFO nova.compute.manager [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Took 8.13 seconds to build instance.
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-74958117-0563-4462-9846-9644619c321f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.245s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-678cffb6-8141-473b-a1ea-8084c3e699f1 req-4b767387-0581-496c-b25b-159602b4dca3 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-unplugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-678cffb6-8141-473b-a1ea-8084c3e699f1 req-4b767387-0581-496c-b25b-159602b4dca3 service nova] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-678cffb6-8141-473b-a1ea-8084c3e699f1 req-4b767387-0581-496c-b25b-159602b4dca3 service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-678cffb6-8141-473b-a1ea-8084c3e699f1 req-4b767387-0581-496c-b25b-159602b4dca3 service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-678cffb6-8141-473b-a1ea-8084c3e699f1 req-4b767387-0581-496c-b25b-159602b4dca3 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] No waiting events found dispatching network-vif-unplugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:56 user nova-compute[74295]: WARNING nova.compute.manager [req-678cffb6-8141-473b-a1ea-8084c3e699f1 req-4b767387-0581-496c-b25b-159602b4dca3 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received unexpected event network-vif-unplugged-16d2b3ee-0200-4890-918e-3caddf53dcaa for instance with vm_state active and task_state rebuilding.
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully created port: 427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:34:56 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance destroyed successfully.
Oct 26 06:34:56 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance destroyed successfully.
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-967869669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1953981053',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW+yK605nx9fsnK9sPq0DGNEhK8lBG6yyAJakl9nS8lcsLe1dpyuMk9N+CMReZkLMBKhi5isWdyprLJbwq8wWYSZ9E2mQUuQM8J+Nd843KWCgj43KxseMsp4FEzwwenUw==',key_name='tempest-keypair-986045003',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:33:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51ec6997c8d74b10901d0d1edca094c8',ramdisk_id='',reservation_id='r-n0bmm11a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1864822632',owner_user_name='tempest-ServerActionsV293TestJSON-1864822632-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='463ace29d09f4b9d9460901159b82aca',uuid=6b441689-7c38-455d-a55e-6cd9615049cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converting VIF {"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_vif [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16d2b3ee-02, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e68ee65d-eee2-435f-85a6-93a27785cc6c) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:56 user nova-compute[74295]: INFO os_vif [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02')
Oct 26 06:34:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtyxVqzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:34:56 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4702be8c-c976-4b6d-8e54-5c43aef747e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:34:56 user nova-compute[74295]: No targets found.
Oct 26 06:34:56 user nova-compute[74295]: iSNS:
Oct 26 06:34:56 user nova-compute[74295]: No targets found.
Oct 26 06:34:56 user nova-compute[74295]: STATIC:
Oct 26 06:34:56 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:34:56 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:56 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:56 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8
Oct 26 06:34:56 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:56 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:56 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9
Oct 26 06:34:56 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:56 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:56 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f
Oct 26 06:34:56 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:56 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:56 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:34:56 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:56 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:56 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:34:56 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:56 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:56 user nova-compute[74295]: FIRMWARE:
Oct 26 06:34:56 user nova-compute[74295]: No targets found.
Oct 26 06:34:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:34:56 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:34:56 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4ca31-a910-4035-b2a4-ca3e271d34df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a43463b-d6f7-4cf3-a339-63ee3eab091e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:34:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:56 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:34:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1bb9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f'): ({'sdf'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Removing single pathed devices sdf {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8909caed-e73e-40ec-b5e2-03df647a6503]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef2e29-1c25-4c76-a4da-17388eb3910a]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Flushing IO for device /dev/sdf {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbc7ce2-7c93-4c1d-92dc-b81eec3467dc]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:34:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906bebe-8611-49a7-809e-a19c4326e3d4]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_76ee7652',) {{(pid=85963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea7637-ef98-4bf1-8027-513147f31580]: (4, None) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d1a431-cf85-44f0-8924-a76dbf15c293]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[566248c1-e5e1-4ffe-8b55-720157f7fef2]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260]
Oct 26 06:34:57 user nova-compute[74295]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260] successful.
Oct 26 06:34:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82d6fc6-5132-484d-8eb6-60273c293e6f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] <== disconnect_volume: return (424ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:34:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Deleting instance files /opt/stack/data/nova/instances/6b441689-7c38-455d-a55e-6cd9615049cf_del
Oct 26 06:34:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Deletion of /opt/stack/data/nova/instances/6b441689-7c38-455d-a55e-6cd9615049cf_del complete
Oct 26 06:34:57 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 6b441689-7c38-455d-a55e-6cd9615049cf could not be found.
Oct 26 06:34:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtyxVqzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:34:57 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4c546b-a67b-4521-b336-a380872e8348]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:34:57 user nova-compute[74295]: No targets found.
Oct 26 06:34:57 user nova-compute[74295]: iSNS:
Oct 26 06:34:57 user nova-compute[74295]: No targets found.
Oct 26 06:34:57 user nova-compute[74295]: STATIC:
Oct 26 06:34:57 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:34:57 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:57 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:57 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8
Oct 26 06:34:57 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:57 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:57 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9
Oct 26 06:34:57 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:57 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:57 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:34:57 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:57 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:57 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:34:57 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:34:57 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:34:57 user nova-compute[74295]: FIRMWARE:
Oct 26 06:34:57 user nova-compute[74295]: No targets found.
Oct 26 06:34:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:34:57 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:34:57 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0200e7f-144b-4fe2-b7e4-a1b974469348]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1af03d-0c32-4be9-b3a6-ffb14bac08f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:57 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:57 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:57 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:57 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:34:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:34:57 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:34:57 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:34:57 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:34:57 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:34:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac74a050>, {}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Disconnecting from: [] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] <== disconnect_volume: return (99ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:34:57 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully created port: 8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:34:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-3a63b579-8b52-42d7-8555-2cff429282b4 req-f37dab64-9536-4548-b040-11e72f933c7e service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3a63b579-8b52-42d7-8555-2cff429282b4 req-f37dab64-9536-4548-b040-11e72f933c7e service nova] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3a63b579-8b52-42d7-8555-2cff429282b4 req-f37dab64-9536-4548-b040-11e72f933c7e service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3a63b579-8b52-42d7-8555-2cff429282b4 req-f37dab64-9536-4548-b040-11e72f933c7e service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-3a63b579-8b52-42d7-8555-2cff429282b4 req-f37dab64-9536-4548-b040-11e72f933c7e service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] No waiting events found dispatching network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:34:58 user nova-compute[74295]: WARNING nova.compute.manager [req-3a63b579-8b52-42d7-8555-2cff429282b4 req-f37dab64-9536-4548-b040-11e72f933c7e service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received unexpected event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa for instance with vm_state active and task_state rebuilding.
Oct 26 06:34:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully created port: ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:34:58 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Preparing to wait for external event volume-reimaged-f879a984-b889-46ee-9eeb-db8d85769e7f {{(pid=74295) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 26 06:34:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:34:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:34:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:34:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully updated port: 867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:34:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-e253cc2b-d8d9-4afb-8ccc-bd648c236359 req-2a506537-7a3f-4109-a0b5-22ae3483f7f1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-changed-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:34:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-e253cc2b-d8d9-4afb-8ccc-bd648c236359 req-2a506537-7a3f-4109-a0b5-22ae3483f7f1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing instance network info cache due to event network-changed-867fc971-1a1f-4258-9543-778eff345dce. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:34:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e253cc2b-d8d9-4afb-8ccc-bd648c236359 req-2a506537-7a3f-4109-a0b5-22ae3483f7f1 service nova] Acquiring lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:34:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e253cc2b-d8d9-4afb-8ccc-bd648c236359 req-2a506537-7a3f-4109-a0b5-22ae3483f7f1 service nova] Acquired lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:34:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-e253cc2b-d8d9-4afb-8ccc-bd648c236359 req-2a506537-7a3f-4109-a0b5-22ae3483f7f1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing network info cache for port 867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:34:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-e253cc2b-d8d9-4afb-8ccc-bd648c236359 req-2a506537-7a3f-4109-a0b5-22ae3483f7f1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:35:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-e253cc2b-d8d9-4afb-8ccc-bd648c236359 req-2a506537-7a3f-4109-a0b5-22ae3483f7f1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e253cc2b-d8d9-4afb-8ccc-bd648c236359 req-2a506537-7a3f-4109-a0b5-22ae3483f7f1 service nova] Releasing lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:35:00 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully updated port: 077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:35:01 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully updated port: 09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:35:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-changed-077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing instance network info cache due to event network-changed-077906d1-ce86-449d-ad27-548e2ceaef33. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:35:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] Acquiring lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:35:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] Acquired lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:35:01 user nova-compute[74295]: DEBUG nova.network.neutron [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing network info cache for port 077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:35:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:01 user nova-compute[74295]: DEBUG nova.network.neutron [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG nova.network.neutron [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully updated port: 72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] Releasing lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-changed-09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing instance network info cache due to event network-changed-09ec26d6-fc41-4da7-8daf-820236267ba0. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] Acquiring lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] Acquired lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG nova.network.neutron [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing network info cache for port 09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG nova.network.neutron [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG nova.network.neutron [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ad710c3b-3c06-4134-aae2-753220a35a97 req-44463dcd-78b4-4f10-b608-8c11a9c9122b service nova] Releasing lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:35:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully updated port: 427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:35:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully updated port: 8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:35:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-changed-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing instance network info cache due to event network-changed-72120d2f-c11b-4a8a-82a1-4c1af2c58e05. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:35:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] Acquiring lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:35:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] Acquired lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:35:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing network info cache for port 72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:35:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] Releasing lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-changed-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing instance network info cache due to event network-changed-427ee207-003c-4b88-9dbe-aef3d8c6fade. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] Acquiring lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] Acquired lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing network info cache for port 427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Successfully updated port: ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] Releasing lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-changed-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing instance network info cache due to event network-changed-8fd6e395-c8d0-4185-a2a7-a3c251931b91. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] Acquiring lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] Acquired lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing network info cache for port 8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1f77dfaf-5dfa-4674-bedc-c4e4a6635319 req-b4b51886-b67f-4651-8033-d7d2f08d6700 service nova] Releasing lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquired lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:35:04 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:35:05 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:35:05 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:35:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-57f529e9-afbd-4731-9192-c9ee49e4b1b6 req-b017e85e-b64e-463d-a5f2-5f674e8508f4 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-changed-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-57f529e9-afbd-4731-9192-c9ee49e4b1b6 req-b017e85e-b64e-463d-a5f2-5f674e8508f4 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing instance network info cache due to event network-changed-ecbe87b8-c45d-48d1-8d89-5413dcf9928c. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-57f529e9-afbd-4731-9192-c9ee49e4b1b6 req-b017e85e-b64e-463d-a5f2-5f674e8508f4 service nova] Acquiring lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [{"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Releasing lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance network_info: |[{"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-57f529e9-afbd-4731-9192-c9ee49e4b1b6 req-b017e85e-b64e-463d-a5f2-5f674e8508f4 service nova] Acquired lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG nova.network.neutron [req-57f529e9-afbd-4731-9192-c9ee49e4b1b6 req-b017e85e-b64e-463d-a5f2-5f674e8508f4 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing network info cache for port ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-57f529e9-afbd-4731-9192-c9ee49e4b1b6 req-b017e85e-b64e-463d-a5f2-5f674e8508f4 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updated VIF entry in instance network info cache for port ecbe87b8-c45d-48d1-8d89-5413dcf9928c. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:35:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-57f529e9-afbd-4731-9192-c9ee49e4b1b6 req-b017e85e-b64e-463d-a5f2-5f674e8508f4 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [{"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-57f529e9-afbd-4731-9192-c9ee49e4b1b6 req-b017e85e-b64e-463d-a5f2-5f674e8508f4 service nova] Releasing lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:35:08 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:35:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:35:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:35:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:35:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:35:09 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updating instance_info_cache with network_info: [{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:35:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:35:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:35:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:35:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:11 user nova-compute[74295]: INFO nova.compute.manager [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Detaching volume f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:35:11 user nova-compute[74295]: INFO nova.virt.block_device [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Attempting to driver detach volume f4d75b2c-b5c2-46ca-b024-e65d7fd922bd from mountpoint /dev/vdb
Oct 26 06:35:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Attempting to detach device vdb from instance cf010631-119f-42b0-a356-a645b27e4081 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:35:11 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:35:11 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:35:11 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:35:11 user nova-compute[74295]:   <serial>f4d75b2c-b5c2-46ca-b024-e65d7fd922bd</serial>
Oct 26 06:35:11 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 06:35:11 user nova-compute[74295]: </disk>
Oct 26 06:35:11 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:35:11 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully detached device vdb from instance cf010631-119f-42b0-a356-a645b27e4081 from the persistent domain config.
Oct 26 06:35:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf010631-119f-42b0-a356-a645b27e4081 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:35:11 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:35:11 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:35:11 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:35:11 user nova-compute[74295]:   <serial>f4d75b2c-b5c2-46ca-b024-e65d7fd922bd</serial>
Oct 26 06:35:11 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 06:35:11 user nova-compute[74295]: </disk>
Oct 26 06:35:11 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf010631-119f-42b0-a356-a645b27e4081 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:12 user nova-compute[74295]: INFO nova.compute.manager [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Terminating instance
Oct 26 06:35:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-218b8c87-be2b-40ba-b1eb-861d6da7ac83 req-8eb011f3-850b-4b5e-8d59-5a1111f7b022 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received event network-vif-unplugged-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-218b8c87-be2b-40ba-b1eb-861d6da7ac83 req-8eb011f3-850b-4b5e-8d59-5a1111f7b022 service nova] Acquiring lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-218b8c87-be2b-40ba-b1eb-861d6da7ac83 req-8eb011f3-850b-4b5e-8d59-5a1111f7b022 service nova] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-218b8c87-be2b-40ba-b1eb-861d6da7ac83 req-8eb011f3-850b-4b5e-8d59-5a1111f7b022 service nova] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-218b8c87-be2b-40ba-b1eb-861d6da7ac83 req-8eb011f3-850b-4b5e-8d59-5a1111f7b022 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] No waiting events found dispatching network-vif-unplugged-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-218b8c87-be2b-40ba-b1eb-861d6da7ac83 req-8eb011f3-850b-4b5e-8d59-5a1111f7b022 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received event network-vif-unplugged-9d4e229d-4afa-4070-b122-f56aaae1d450 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Instance destroyed successfully.
Oct 26 06:35:13 user nova-compute[74295]: DEBUG nova.objects.instance [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lazy-loading 'resources' on Instance uuid c9208b1d-a8e2-4806-942b-e19ebbe3e3d9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-212607490',display_name='tempest-ServersNegativeTestJSON-server-212607490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-212607490',id=20,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:33:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beceb88c1357495f9a2a600dc7bbfa1f',ramdisk_id='',reservation_id='r-mk4nr6mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-274276408',owner_user_name='tempest-ServersNegativeTestJSON-274276408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:33:28Z,user_data=None,user_id='91925e095e034d3cb49445f191f910b1',uuid=c9208b1d-a8e2-4806-942b-e19ebbe3e3d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converting VIF {"id": "9d4e229d-4afa-4070-b122-f56aaae1d450", "address": "fa:16:3e:3f:46:f3", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d4e229d-4a", "ovs_interfaceid": "9d4e229d-4afa-4070-b122-f56aaae1d450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:46:f3,bridge_name='br-int',has_traffic_filtering=True,id=9d4e229d-4afa-4070-b122-f56aaae1d450,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4e229d-4a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG os_vif [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:46:f3,bridge_name='br-int',has_traffic_filtering=True,id=9d4e229d-4afa-4070-b122-f56aaae1d450,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4e229d-4a') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d4e229d-4a, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=799f49c7-8649-4283-8dcb-9abea4dfc92b) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:35:13 user nova-compute[74295]: INFO os_vif [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:46:f3,bridge_name='br-int',has_traffic_filtering=True,id=9d4e229d-4afa-4070-b122-f56aaae1d450,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d4e229d-4a')
Oct 26 06:35:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Deleting instance files /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9_del
Oct 26 06:35:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Deletion of /opt/stack/data/nova/instances/c9208b1d-a8e2-4806-942b-e19ebbe3e3d9_del complete
Oct 26 06:35:13 user nova-compute[74295]: INFO nova.compute.manager [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:13 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-ed8bba93-fb40-450b-9959-ae1732caa105 req-b57a904a-3806-4276-8906-b35bd7cd56c4 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received event network-vif-deleted-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:14 user nova-compute[74295]: INFO nova.compute.manager [req-ed8bba93-fb40-450b-9959-ae1732caa105 req-b57a904a-3806-4276-8906-b35bd7cd56c4 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Neutron deleted interface 9d4e229d-4afa-4070-b122-f56aaae1d450; detaching it from the instance and deleting it from the info cache
Oct 26 06:35:14 user nova-compute[74295]: DEBUG nova.network.neutron [req-ed8bba93-fb40-450b-9959-ae1732caa105 req-b57a904a-3806-4276-8906-b35bd7cd56c4 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:35:14 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Took 0.79 seconds to deallocate network for instance.
Oct 26 06:35:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-ed8bba93-fb40-450b-9959-ae1732caa105 req-b57a904a-3806-4276-8906-b35bd7cd56c4 service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Detach interface failed, port_id=9d4e229d-4afa-4070-b122-f56aaae1d450, reason: Instance c9208b1d-a8e2-4806-942b-e19ebbe3e3d9 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-7595f05d-f61a-4650-82c6-acbfaf1e9bbe req-64f09de7-f73d-4924-8100-2abe1424c2fd service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received event network-vif-plugged-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7595f05d-f61a-4650-82c6-acbfaf1e9bbe req-64f09de7-f73d-4924-8100-2abe1424c2fd service nova] Acquiring lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7595f05d-f61a-4650-82c6-acbfaf1e9bbe req-64f09de7-f73d-4924-8100-2abe1424c2fd service nova] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7595f05d-f61a-4650-82c6-acbfaf1e9bbe req-64f09de7-f73d-4924-8100-2abe1424c2fd service nova] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-7595f05d-f61a-4650-82c6-acbfaf1e9bbe req-64f09de7-f73d-4924-8100-2abe1424c2fd service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] No waiting events found dispatching network-vif-plugged-9d4e229d-4afa-4070-b122-f56aaae1d450 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:35:14 user nova-compute[74295]: WARNING nova.compute.manager [req-7595f05d-f61a-4650-82c6-acbfaf1e9bbe req-64f09de7-f73d-4924-8100-2abe1424c2fd service nova] [instance: c9208b1d-a8e2-4806-942b-e19ebbe3e3d9] Received unexpected event network-vif-plugged-9d4e229d-4afa-4070-b122-f56aaae1d450 for instance with vm_state deleted and task_state None.
Oct 26 06:35:14 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.646s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:14 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Deleted allocations for instance c9208b1d-a8e2-4806-942b-e19ebbe3e3d9
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b53dbe5-7b11-42af-a5bb-9526e0edba68 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "c9208b1d-a8e2-4806-942b-e19ebbe3e3d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.666s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:16 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:35:16 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=6946MB free_disk=25.217453002929688GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cf010631-119f-42b0-a356-a645b27e4081 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1f13ee5-22e7-466c-a117-ae4a707ad2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 0440536c-c9ad-439e-aa26-689b945c63ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 6b441689-7c38-455d-a55e-6cd9615049cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 89e21688-5d9e-492e-90ce-bf626963e6c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d6c25b84-4b35-4086-89a5-d5f2823b507a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 5610d9b7-e38f-450b-b395-480c4131f1be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:35:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.764s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:17 user nova-compute[74295]: INFO nova.virt.block_device [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Booting with volume 9c9b2dd4-894f-4b15-a2c0-3c6e36466813 at /dev/vdb
Oct 26 06:35:17 user nova-compute[74295]: DEBUG os_brick.utils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c04331f-ef95-49cd-b096-abfe4d63393d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[156fc28b-039f-4805-9f3d-ef6b5a547482]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5e4a1-22a8-48ed-96d5-f97a449318b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3061b068-9223-4521-8cb8-c831be6dc206]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:35:17 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:35:17 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda9aaa7-b71f-498a-b6aa-aea493e204e8]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG os_brick.utils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:35:17 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating existing volume attachment record: 23ab9504-e6c6-4578-a8bc-078f9180b718 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:35:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:35:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:35:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:35:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:32 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cf010631-119f-42b0-a356-a645b27e4081 is timed out.
Oct 26 06:35:32 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully detached device vdb from instance cf010631-119f-42b0-a356-a645b27e4081 from the live domain config.
Oct 26 06:35:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUPBDXFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:35:32 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[26669260-a4d5-4153-95f3-cd8314645ed8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:35:32 user nova-compute[74295]: No targets found.
Oct 26 06:35:32 user nova-compute[74295]: iSNS:
Oct 26 06:35:32 user nova-compute[74295]: No targets found.
Oct 26 06:35:32 user nova-compute[74295]: STATIC:
Oct 26 06:35:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:35:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:35:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:35:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8
Oct 26 06:35:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:35:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:35:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9
Oct 26 06:35:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:35:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:35:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:35:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:35:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:35:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd
Oct 26 06:35:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:35:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:35:32 user nova-compute[74295]: FIRMWARE:
Oct 26 06:35:32 user nova-compute[74295]: No targets found.
Oct 26 06:35:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:35:32 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:35:32 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d9e1e6-c091-480b-a23c-8ec3642c73f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc650d7b-88bf-4013-aed2-a36dcfbaba82]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:35:32 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:35:32 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:35:32 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:35:32 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:35:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:35:32 user nova-compute[74295]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd (non-flash)
Oct 26 06:35:32 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:35:32 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:35:32 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:35:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac730670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd'): ({'sde'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Removing single pathed devices sde {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5b8e9d-cd64-4f1c-a603-1d1a065e745b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfcbb9f-869f-4109-9b2b-5c7dd4decdf2]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flushing IO for device /dev/sde {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16b5775-6f0c-4d4c-b43a-0244bb677c22]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3ff0e5-8813-4173-adf4-1be1aee17643]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b8e9ea-be67-4788-bcbf-e29a7b3dc9db]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981cb0a-6a06-494a-b535-d2f1d29d4c63]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260]
Oct 26 06:35:32 user nova-compute[74295]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd, portal: 172.16.0.220,3260] successful.
Oct 26 06:35:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d75b2c-b5c2-46ca-b024-e65d7fd922bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40ab623-4a43-4fde-a999-8390965baf0b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== disconnect_volume: return (319ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:35:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:35:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:35:33 user nova-compute[74295]: DEBUG nova.objects.instance [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'flavor' on Instance uuid cf010631-119f-42b0-a356-a645b27e4081 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:35:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-364b17dc-def3-46d2-b989-f315915c39df tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.848s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:35:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:35:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 req-c91c9c26-6e3c-48ad-a599-4fd86cb2a9c4 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event volume-reimaged-f879a984-b889-46ee-9eeb-db8d85769e7f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 req-c91c9c26-6e3c-48ad-a599-4fd86cb2a9c4 service nova] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 req-c91c9c26-6e3c-48ad-a599-4fd86cb2a9c4 service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 req-c91c9c26-6e3c-48ad-a599-4fd86cb2a9c4 service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 req-c91c9c26-6e3c-48ad-a599-4fd86cb2a9c4 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Processing event volume-reimaged-f879a984-b889-46ee-9eeb-db8d85769e7f {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 26 06:35:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance event wait completed in 44 seconds for volume-reimaged {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:35:43 user nova-compute[74295]: INFO nova.virt.block_device [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Booting with volume f879a984-b889-46ee-9eeb-db8d85769e7f at /dev/vda
Oct 26 06:35:44 user nova-compute[74295]: DEBUG os_brick.utils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0ce72b-75fc-4bf2-a096-bff039ba96b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f060bb8-bd92-48d0-91a0-8291aef142a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[091a07e7-960e-4102-b577-fda7a52621ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1e0f26-dd44-4cf7-9a64-a565c538e346]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:35:44 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:35:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fe289c-dc67-44c9-8dad-b5a30f83455e]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG os_brick.utils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:35:44 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Updating existing volume attachment record: 6043ad70-150d-4ec8-91ca-83475085b3e1 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:35:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:49 user nova-compute[74295]: INFO nova.virt.block_device [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Booting with volume df1d4713-afc3-4af5-914a-4f0fdfb8e685 at /dev/vdc
Oct 26 06:35:49 user nova-compute[74295]: DEBUG os_brick.utils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0937eb1-c252-430c-9b84-7ff4b120e5db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc3cfc-045c-4d9e-b990-2eae67993f4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3988db-81a1-48dc-9a9f-37d7ab0bf049]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb53e8bb-77fd-44c4-85cd-6c802666ba2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:35:49 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:35:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1049ab6f-51f4-49c5-a61e-48d55f8f5e74]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG os_brick.utils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:35:49 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating existing volume attachment record: 34191093-09c3-4101-af0b-8e281d4888a9 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:35:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:59 user nova-compute[74295]: INFO nova.compute.manager [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Terminating instance
Oct 26 06:35:59 user nova-compute[74295]: DEBUG nova.compute.manager [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-c7e6845c-2f2e-423b-a22f-5c7ffc70f801 req-8222ee45-a728-4b70-bcf2-8e53edd89af8 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-unplugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c7e6845c-2f2e-423b-a22f-5c7ffc70f801 req-8222ee45-a728-4b70-bcf2-8e53edd89af8 service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c7e6845c-2f2e-423b-a22f-5c7ffc70f801 req-8222ee45-a728-4b70-bcf2-8e53edd89af8 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c7e6845c-2f2e-423b-a22f-5c7ffc70f801 req-8222ee45-a728-4b70-bcf2-8e53edd89af8 service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-c7e6845c-2f2e-423b-a22f-5c7ffc70f801 req-8222ee45-a728-4b70-bcf2-8e53edd89af8 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-unplugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:35:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-c7e6845c-2f2e-423b-a22f-5c7ffc70f801 req-8222ee45-a728-4b70-bcf2-8e53edd89af8 service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-unplugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Instance destroyed successfully.
Oct 26 06:36:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lazy-loading 'resources' on Instance uuid 775d5e2e-95a6-4a86-b6f3-ce96735378d9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-97936637',display_name='tempest-ServerActionsTestOtherB-server-97936637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-97936637',id=4,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmm1IaoBoVd8Hkv3gtx/L78lFPzYOW0A2Qqc9FfseOv4MiM64O4tVX1rCM39AF+LH46KHkGVTicvdWviQLc+ppyTXiLGRvBGUpaFnTBwUaROd5zinEiEdd3gXRLbgwTBg==',key_name='tempest-keypair-393220372',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd8a2b9f8cce49d4985549fd42dc1e8a',ramdisk_id='',reservation_id='r-cmxn1myp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-406693711',owner_user_name='tempest-ServerActionsTestOtherB-406693711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e44a6886b2b478dbca031edd15a9a6f',uuid=775d5e2e-95a6-4a86-b6f3-ce96735378d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converting VIF {"id": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "address": "fa:16:3e:ad:4f:d9", "network": {"id": "78da908b-4d98-4987-80b7-5d61ab7adbb6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971519128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8a2b9f8cce49d4985549fd42dc1e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e3fe7f-b7", "ovs_interfaceid": "f0e3fe7f-b73a-48b6-bc9d-adac272022b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_vif [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0e3fe7f-b7, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=559cee94-7feb-4364-922f-545af20adce6) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:00 user nova-compute[74295]: INFO os_vif [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4f:d9,bridge_name='br-int',has_traffic_filtering=True,id=f0e3fe7f-b73a-48b6-bc9d-adac272022b4,network=Network(78da908b-4d98-4987-80b7-5d61ab7adbb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e3fe7f-b7')
Oct 26 06:36:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RFgsenmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:36:00 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95ace28-dc39-4a3f-ac99-bd73b74d60a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:36:00 user nova-compute[74295]: No targets found.
Oct 26 06:36:00 user nova-compute[74295]: iSNS:
Oct 26 06:36:00 user nova-compute[74295]: No targets found.
Oct 26 06:36:00 user nova-compute[74295]: STATIC:
Oct 26 06:36:00 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b
Oct 26 06:36:00 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:36:00 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:36:00 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8
Oct 26 06:36:00 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:36:00 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:36:00 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9
Oct 26 06:36:00 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:36:00 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:36:00 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:36:00 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:36:00 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:36:00 user nova-compute[74295]: FIRMWARE:
Oct 26 06:36:00 user nova-compute[74295]: No targets found.
Oct 26 06:36:00 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:36:00 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:36:00 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[719a46bc-50e8-4e7e-9d03-c0a7d8836659]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[56df7072-2e0c-4ab4-8e33-bfeec25c70b5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:00 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:36:00 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:00 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:00 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:00 user nova-compute[74295]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b (non-flash)
Oct 26 06:36:00 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:00 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:00 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac7483a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b'): ({'sdg'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Removing single pathed devices sdg {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb303a4-ccad-4f39-b177-e844a6fb2148]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fcbfa8-b65d-49a6-bbae-cbb0296a4dff]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Flushing IO for device /dev/sdg {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9b5cf-e31c-4f1f-9a77-9663ff2d322b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c75dba-ac4a-41ee-bf1e-79cf14d455af]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] SCSI volumes sdg have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b6135c-3721-4fa0-94c1-025cb3f0c66a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b6282c-5e7c-45d6-ac97-9a0c298510f9]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260]
Oct 26 06:36:00 user nova-compute[74295]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b, portal: 172.16.0.220,3260] successful.
Oct 26 06:36:00 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f212bc3-b89c-4588-9186-df7b86c44e6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e35347a-5eec-40a8-943b-8ad419676519]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] <== disconnect_volume: return (349ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:36:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:36:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Deleting instance files /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9_del
Oct 26 06:36:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Deletion of /opt/stack/data/nova/instances/775d5e2e-95a6-4a86-b6f3-ce96735378d9_del complete
Oct 26 06:36:01 user nova-compute[74295]: INFO nova.compute.manager [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 26 06:36:01 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:01 user nova-compute[74295]: INFO nova.compute.manager [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Terminating instance
Oct 26 06:36:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-b06fb743-1b3a-4122-be4e-2c9b571a8d66 req-135b4d0e-3a1f-4744-bb4e-6344c78682ee service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b06fb743-1b3a-4122-be4e-2c9b571a8d66 req-135b4d0e-3a1f-4744-bb4e-6344c78682ee service nova] Acquiring lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b06fb743-1b3a-4122-be4e-2c9b571a8d66 req-135b4d0e-3a1f-4744-bb4e-6344c78682ee service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b06fb743-1b3a-4122-be4e-2c9b571a8d66 req-135b4d0e-3a1f-4744-bb4e-6344c78682ee service nova] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-b06fb743-1b3a-4122-be4e-2c9b571a8d66 req-135b4d0e-3a1f-4744-bb4e-6344c78682ee service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] No waiting events found dispatching network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:02 user nova-compute[74295]: WARNING nova.compute.manager [req-b06fb743-1b3a-4122-be4e-2c9b571a8d66 req-135b4d0e-3a1f-4744-bb4e-6344c78682ee service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received unexpected event network-vif-plugged-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 for instance with vm_state active and task_state deleting.
Oct 26 06:36:02 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cf010631-119f-42b0-a356-a645b27e4081] Instance destroyed successfully.
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.objects.instance [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'resources' on Instance uuid cf010631-119f-42b0-a356-a645b27e4081 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-213606875',display_name='tempest-ServerActionsTestOtherA-server-1405397235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-213606875',id=14,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtH+FO/rcPVmXXNwudgrvBLEMmMcqmnAHUrdcVJlWtaZpsycsfMyvP1tJmmBYEi4UMNSFlb3baPyXSYG4kOajpOED31FcaPy44SBBtSx6sYgvc6+6JiuCiXwwpnNliueA==',key_name='tempest-keypair-1139203649',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:32:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-k4edxa0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:32:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=cf010631-119f-42b0-a356-a645b27e4081,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "2b5d323f-8884-4acb-a176-40dfcf957402", "address": "fa:16:3e:59:49:33", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b5d323f-88", "ovs_interfaceid": "2b5d323f-8884-4acb-a176-40dfcf957402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG os_vif [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b5d323f-88, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5438dc1d-9956-46c0-a0b0-9029977c4a09) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:02 user nova-compute[74295]: INFO os_vif [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:49:33,bridge_name='br-int',has_traffic_filtering=True,id=2b5d323f-8884-4acb-a176-40dfcf957402,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b5d323f-88')
Oct 26 06:36:02 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Deleting instance files /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081_del
Oct 26 06:36:02 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Deletion of /opt/stack/data/nova/instances/cf010631-119f-42b0-a356-a645b27e4081_del complete
Oct 26 06:36:02 user nova-compute[74295]: INFO nova.compute.manager [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: cf010631-119f-42b0-a356-a645b27e4081] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 06:36:02 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: cf010631-119f-42b0-a356-a645b27e4081] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: cf010631-119f-42b0-a356-a645b27e4081] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-39b25b04-212c-428f-9011-3ddc8c580a39 req-2e76d609-d9b5-4b8a-a668-7fb6113985e5 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-unplugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-39b25b04-212c-428f-9011-3ddc8c580a39 req-2e76d609-d9b5-4b8a-a668-7fb6113985e5 service nova] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-39b25b04-212c-428f-9011-3ddc8c580a39 req-2e76d609-d9b5-4b8a-a668-7fb6113985e5 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-39b25b04-212c-428f-9011-3ddc8c580a39 req-2e76d609-d9b5-4b8a-a668-7fb6113985e5 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-39b25b04-212c-428f-9011-3ddc8c580a39 req-2e76d609-d9b5-4b8a-a668-7fb6113985e5 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] No waiting events found dispatching network-vif-unplugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-39b25b04-212c-428f-9011-3ddc8c580a39 req-2e76d609-d9b5-4b8a-a668-7fb6113985e5 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-unplugged-2b5d323f-8884-4acb-a176-40dfcf957402 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:36:02 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:36:02 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Took 1.80 seconds to deallocate network for instance.
Oct 26 06:36:03 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: cf010631-119f-42b0-a356-a645b27e4081] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:36:03 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: cf010631-119f-42b0-a356-a645b27e4081] Took 0.97 seconds to deallocate network for instance.
Oct 26 06:36:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-d932ecf7-fd1d-4a85-8419-099671cf0098 req-3dc16ada-6964-484e-8e53-5d98165e54ef service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-deleted-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:03 user nova-compute[74295]: INFO nova.compute.manager [req-d932ecf7-fd1d-4a85-8419-099671cf0098 req-3dc16ada-6964-484e-8e53-5d98165e54ef service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Neutron deleted interface 2b5d323f-8884-4acb-a176-40dfcf957402; detaching it from the instance and deleting it from the info cache
Oct 26 06:36:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-d932ecf7-fd1d-4a85-8419-099671cf0098 req-3dc16ada-6964-484e-8e53-5d98165e54ef service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:36:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-d932ecf7-fd1d-4a85-8419-099671cf0098 req-3dc16ada-6964-484e-8e53-5d98165e54ef service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Detach interface failed, port_id=2b5d323f-8884-4acb-a176-40dfcf957402, reason: Instance cf010631-119f-42b0-a356-a645b27e4081 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:36:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:03 user nova-compute[74295]: INFO nova.compute.manager [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Took 0.99 seconds to detach 1 volumes for instance.
Oct 26 06:36:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.426s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:04 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Deleted allocations for instance cf010631-119f-42b0-a356-a645b27e4081
Oct 26 06:36:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-61cdd23f-e400-4be3-968d-32051d54d698 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "cf010631-119f-42b0-a356-a645b27e4081" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.640s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-237ae943-fdd2-4710-b378-082f14365aa9 req-ef64bd1a-9420-48d2-bafe-bedc771afe2b service nova] [instance: 775d5e2e-95a6-4a86-b6f3-ce96735378d9] Received event network-vif-deleted-f0e3fe7f-b73a-48b6-bc9d-adac272022b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:04 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Deleted allocations for instance 775d5e2e-95a6-4a86-b6f3-ce96735378d9
Oct 26 06:36:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-b0b4c429-299e-4747-b20b-ff16e0ddcdcc req-d1b7b0dc-206c-43ac-aead-b92ffe36bef8 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b0b4c429-299e-4747-b20b-ff16e0ddcdcc req-d1b7b0dc-206c-43ac-aead-b92ffe36bef8 service nova] Acquiring lock "cf010631-119f-42b0-a356-a645b27e4081-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b0b4c429-299e-4747-b20b-ff16e0ddcdcc req-d1b7b0dc-206c-43ac-aead-b92ffe36bef8 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b0b4c429-299e-4747-b20b-ff16e0ddcdcc req-d1b7b0dc-206c-43ac-aead-b92ffe36bef8 service nova] Lock "cf010631-119f-42b0-a356-a645b27e4081-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-b0b4c429-299e-4747-b20b-ff16e0ddcdcc req-d1b7b0dc-206c-43ac-aead-b92ffe36bef8 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] No waiting events found dispatching network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:04 user nova-compute[74295]: WARNING nova.compute.manager [req-b0b4c429-299e-4747-b20b-ff16e0ddcdcc req-d1b7b0dc-206c-43ac-aead-b92ffe36bef8 service nova] [instance: cf010631-119f-42b0-a356-a645b27e4081] Received unexpected event network-vif-plugged-2b5d323f-8884-4acb-a176-40dfcf957402 for instance with vm_state deleted and task_state None.
Oct 26 06:36:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56e6e4d0-6935-4ff0-ac7d-4af56bb2158c tempest-ServerActionsTestOtherB-406693711 tempest-ServerActionsTestOtherB-406693711-project-member] Lock "775d5e2e-95a6-4a86-b6f3-ce96735378d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.332s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:36:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Creating image(s)
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Ensure instance console log exists: /opt/stack/data/nova/instances/6b441689-7c38-455d-a55e-6cd9615049cf/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Start _get_guest_xml network_info=[{"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '6043ad70-150d-4ec8-91ca-83475085b3e1', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtyxVqzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b441689-7c38-455d-a55e-6cd9615049cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'f879a984-b889-46ee-9eeb-db8d85769e7f', 'serial': 'f879a984-b889-46ee-9eeb-db8d85769e7f'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:36:06 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 06:36:06 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b441689-7c38-455d-a55e-6cd9615049cf {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtyxVqzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:36:06 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:36:06 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:36:06 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a890eb73-9d66-494a-9464-f29cc3e42f4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:36:06 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[31819d06-08be-4fe6-9a08-201c82ca1fa4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f] added
Oct 26 06:36:06 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[217989bd-4a65-4b85-9f8e-2c1a38a727b2]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4647e9-3d5e-4c2b-a5d3-77a3b1dd0586]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EtyxVqzM {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EtyxVqzM" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d2278-ac36-4a25-bb7e-ec446db198f5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EtyxVqzM'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba1b28-07ae-487a-bda0-465b462ffff2]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d9508c-bb0c-4fd1-ac8a-c209bafd64e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5979e4a3-1a50-4978-9b5e-f4f14b3d9e98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260]
Oct 26 06:36:06 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260] successful.
Oct 26 06:36:06 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[819cccc3-cf5a-4bf3-ac24-ddf082256914]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd857be-5e61-4c7a-9289-6a60e708a71b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:06 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:06 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:06 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f05eb2-d1eb-4a3e-926b-2c73858d7a86]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:36:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtyxVqzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:36:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:36:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23766656263373937', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:36:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766656263373937', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-967869669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1953981053',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW+yK605nx9fsnK9sPq0DGNEhK8lBG6yyAJakl9nS8lcsLe1dpyuMk9N+CMReZkLMBKhi5isWdyprLJbwq8wWYSZ9E2mQUuQM8J+Nd843KWCgj43KxseMsp4FEzwwenUw==',key_name='tempest-keypair-986045003',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:33:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51ec6997c8d74b10901d0d1edca094c8',ramdisk_id='',reservation_id='r-n0bmm11a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1864822632',owner_user_name='tempest-ServerActionsV293TestJSON-1864822632-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='463ace29d09f4b9d9460901159b82aca',uuid=6b441689-7c38-455d-a55e-6cd9615049cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converting VIF {"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:36:08 user nova-compute[74295]:   <uuid>6b441689-7c38-455d-a55e-6cd9615049cf</uuid>
Oct 26 06:36:08 user nova-compute[74295]:   <name>instance-00000013</name>
Oct 26 06:36:08 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:36:08 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:36:08 user nova-compute[74295]:   <metadata>
Oct 26 06:36:08 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:36:08 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:36:08 user nova-compute[74295]:       <nova:name>tempest-ServerActionsV293TestJSON-server-967869669</nova:name>
Oct 26 06:36:08 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:36:06</nova:creationTime>
Oct 26 06:36:08 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:36:08 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:36:08 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:36:08 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:36:08 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:36:08 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:36:08 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:36:08 user nova-compute[74295]:       <nova:owner>
Oct 26 06:36:08 user nova-compute[74295]:         <nova:user uuid="463ace29d09f4b9d9460901159b82aca">tempest-ServerActionsV293TestJSON-1864822632-project-member</nova:user>
Oct 26 06:36:08 user nova-compute[74295]:         <nova:project uuid="51ec6997c8d74b10901d0d1edca094c8">tempest-ServerActionsV293TestJSON-1864822632</nova:project>
Oct 26 06:36:08 user nova-compute[74295]:       </nova:owner>
Oct 26 06:36:08 user nova-compute[74295]:       <nova:ports>
Oct 26 06:36:08 user nova-compute[74295]:         <nova:port uuid="16d2b3ee-0200-4890-918e-3caddf53dcaa">
Oct 26 06:36:08 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 06:36:08 user nova-compute[74295]:         </nova:port>
Oct 26 06:36:08 user nova-compute[74295]:       </nova:ports>
Oct 26 06:36:08 user nova-compute[74295]:     </nova:instance>
Oct 26 06:36:08 user nova-compute[74295]:   </metadata>
Oct 26 06:36:08 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:36:08 user nova-compute[74295]:     <system>
Oct 26 06:36:08 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:36:08 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:36:08 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:36:08 user nova-compute[74295]:       <entry name="serial">6b441689-7c38-455d-a55e-6cd9615049cf</entry>
Oct 26 06:36:08 user nova-compute[74295]:       <entry name="uuid">6b441689-7c38-455d-a55e-6cd9615049cf</entry>
Oct 26 06:36:08 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:36:08 user nova-compute[74295]:     </system>
Oct 26 06:36:08 user nova-compute[74295]:   </sysinfo>
Oct 26 06:36:08 user nova-compute[74295]:   <os>
Oct 26 06:36:08 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:36:08 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:36:08 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:36:08 user nova-compute[74295]:   </os>
Oct 26 06:36:08 user nova-compute[74295]:   <features>
Oct 26 06:36:08 user nova-compute[74295]:     <acpi/>
Oct 26 06:36:08 user nova-compute[74295]:     <apic/>
Oct 26 06:36:08 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:36:08 user nova-compute[74295]:   </features>
Oct 26 06:36:08 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:36:08 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:36:08 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:36:08 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:36:08 user nova-compute[74295]:   </clock>
Oct 26 06:36:08 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:36:08 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:36:08 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:36:08 user nova-compute[74295]:   </cpu>
Oct 26 06:36:08 user nova-compute[74295]:   <devices>
Oct 26 06:36:08 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:36:08 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:36:08 user nova-compute[74295]:       <source dev="/dev/sdd"/>
Oct 26 06:36:08 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:36:08 user nova-compute[74295]:       <serial>f879a984-b889-46ee-9eeb-db8d85769e7f</serial>
Oct 26 06:36:08 user nova-compute[74295]:     </disk>
Oct 26 06:36:08 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:36:08 user nova-compute[74295]:       <mac address="fa:16:3e:12:22:a2"/>
Oct 26 06:36:08 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:08 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:36:08 user nova-compute[74295]:       <target dev="tap16d2b3ee-02"/>
Oct 26 06:36:08 user nova-compute[74295]:     </interface>
Oct 26 06:36:08 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:36:08 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/6b441689-7c38-455d-a55e-6cd9615049cf/console.log" append="off"/>
Oct 26 06:36:08 user nova-compute[74295]:     </serial>
Oct 26 06:36:08 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:36:08 user nova-compute[74295]:     <video>
Oct 26 06:36:08 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:08 user nova-compute[74295]:     </video>
Oct 26 06:36:08 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:36:08 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:36:08 user nova-compute[74295]:     </rng>
Oct 26 06:36:08 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:36:08 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:36:08 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:36:08 user nova-compute[74295]:     </memballoon>
Oct 26 06:36:08 user nova-compute[74295]:   </devices>
Oct 26 06:36:08 user nova-compute[74295]: </domain>
Oct 26 06:36:08 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-967869669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1953981053',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW+yK605nx9fsnK9sPq0DGNEhK8lBG6yyAJakl9nS8lcsLe1dpyuMk9N+CMReZkLMBKhi5isWdyprLJbwq8wWYSZ9E2mQUuQM8J+Nd843KWCgj43KxseMsp4FEzwwenUw==',key_name='tempest-keypair-986045003',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:33:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51ec6997c8d74b10901d0d1edca094c8',ramdisk_id='',reservation_id='r-n0bmm11a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1864822632',owner_user_name='tempest-ServerActionsV293TestJSON-1864822632-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='463ace29d09f4b9d9460901159b82aca',uuid=6b441689-7c38-455d-a55e-6cd9615049cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converting VIF {"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG os_vif [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4a84724-7713-5512-9da6-9220e8fe1987', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16d2b3ee-02, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16d2b3ee-02, col_values=(('qos', UUID('0ebee170-d869-436c-86b5-03ab98d302ea')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16d2b3ee-02, col_values=(('external_ids', {'iface-id': '16d2b3ee-0200-4890-918e-3caddf53dcaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:22:a2', 'vm-uuid': '6b441689-7c38-455d-a55e-6cd9615049cf'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:08 user nova-compute[74295]: INFO os_vif [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02')
Oct 26 06:36:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] No VIF found with MAC fa:16:3e:12:22:a2, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:36:08 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-d91e001a-bdb8-483d-9eee-ea509fefcf89 req-b418d0b4-a5ba-4f4f-8e7c-6beaa6160391 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d91e001a-bdb8-483d-9eee-ea509fefcf89 req-b418d0b4-a5ba-4f4f-8e7c-6beaa6160391 service nova] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d91e001a-bdb8-483d-9eee-ea509fefcf89 req-b418d0b4-a5ba-4f4f-8e7c-6beaa6160391 service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d91e001a-bdb8-483d-9eee-ea509fefcf89 req-b418d0b4-a5ba-4f4f-8e7c-6beaa6160391 service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-d91e001a-bdb8-483d-9eee-ea509fefcf89 req-b418d0b4-a5ba-4f4f-8e7c-6beaa6160391 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] No waiting events found dispatching network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:09 user nova-compute[74295]: WARNING nova.compute.manager [req-d91e001a-bdb8-483d-9eee-ea509fefcf89 req-b418d0b4-a5ba-4f4f-8e7c-6beaa6160391 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received unexpected event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa for instance with vm_state active and task_state rebuild_spawning.
Oct 26 06:36:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-266e3dc8-e01a-44f1-b124-7772c4405d68 req-decce868-7fd4-4308-8d3f-b7e0357bd4bc service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-266e3dc8-e01a-44f1-b124-7772c4405d68 req-decce868-7fd4-4308-8d3f-b7e0357bd4bc service nova] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-266e3dc8-e01a-44f1-b124-7772c4405d68 req-decce868-7fd4-4308-8d3f-b7e0357bd4bc service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-266e3dc8-e01a-44f1-b124-7772c4405d68 req-decce868-7fd4-4308-8d3f-b7e0357bd4bc service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-266e3dc8-e01a-44f1-b124-7772c4405d68 req-decce868-7fd4-4308-8d3f-b7e0357bd4bc service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] No waiting events found dispatching network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:11 user nova-compute[74295]: WARNING nova.compute.manager [req-266e3dc8-e01a-44f1-b124-7772c4405d68 req-decce868-7fd4-4308-8d3f-b7e0357bd4bc service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received unexpected event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa for instance with vm_state active and task_state rebuild_spawning.
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:36:11 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance spawned successfully.
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74295) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c70457a6-dfdc-43d3-a8d4-b82b2dfbcba8 tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:36:12 user nova-compute[74295]: INFO nova.compute.claims [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Claim successful on node user
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:36:12 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:36:12 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:36:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG nova.policy [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f6d23275c654de1926a7cb988451d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8af562736824561a4f55f68f27a0b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:36:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Creating image(s)
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "/opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "/opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.213s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk 1073741824" returned: 0 in 0.057s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Successfully created port: d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Cannot resize image /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Ensure instance console log exists: /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Successfully updated port: d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-8a565f53-1141-4bab-91b0-f5f988543a98 req-fd29f88f-69e3-4bc8-938d-8562f6a4c076 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-changed-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-8a565f53-1141-4bab-91b0-f5f988543a98 req-fd29f88f-69e3-4bc8-938d-8562f6a4c076 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Refreshing instance network info cache due to event network-changed-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8a565f53-1141-4bab-91b0-f5f988543a98 req-fd29f88f-69e3-4bc8-938d-8562f6a4c076 service nova] Acquiring lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8a565f53-1141-4bab-91b0-f5f988543a98 req-fd29f88f-69e3-4bc8-938d-8562f6a4c076 service nova] Acquired lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.network.neutron [req-8a565f53-1141-4bab-91b0-f5f988543a98 req-fd29f88f-69e3-4bc8-938d-8562f6a4c076 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Refreshing network info cache for port d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:36:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:36:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:36:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7317MB free_disk=25.259262084960938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-8a565f53-1141-4bab-91b0-f5f988543a98 req-fd29f88f-69e3-4bc8-938d-8562f6a4c076 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1f13ee5-22e7-466c-a117-ae4a707ad2bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 0440536c-c9ad-439e-aa26-689b945c63ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 6b441689-7c38-455d-a55e-6cd9615049cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 89e21688-5d9e-492e-90ce-bf626963e6c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d6c25b84-4b35-4086-89a5-d5f2823b507a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 5610d9b7-e38f-450b-b395-480c4131f1be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fb03897e-7f9e-497a-b703-ca862b11672f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-8a565f53-1141-4bab-91b0-f5f988543a98 req-fd29f88f-69e3-4bc8-938d-8562f6a4c076 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8a565f53-1141-4bab-91b0-f5f988543a98 req-fd29f88f-69e3-4bc8-938d-8562f6a4c076 service nova] Releasing lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquired lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Updating instance_info_cache with network_info: [{"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Releasing lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Instance network_info: |[{"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Start _get_guest_xml network_info=[{"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:36:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:36:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-474204970',display_name='tempest-TestStampPattern-server-474204970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-474204970',id=25,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEAdKcn8BfIKAadtFceMe64jXIA47ijBG6BK3Cx0+eFXmVCy7VFEkebqDvzRsQ0zTl6IjK9Qm73ynWPZigB9lmyvdFYYVp4BU04c1HSaUw88rA3kLK5vGAV3HV0ee2Bw==',key_name='tempest-TestStampPattern-1605295167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8af562736824561a4f55f68f27a0b85',ramdisk_id='',reservation_id='r-w394cdzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-91727882',owner_user_name='tempest-TestStampPattern-91727882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:36:13Z,user_data=None,user_id='5f6d23275c654de1926a7cb988451d10',uuid=fb03897e-7f9e-497a-b703-ca862b11672f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converting VIF {"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:31:20,bridge_name='br-int',has_traffic_filtering=True,id=d745ae1a-25c3-4f4e-bfaa-4462ae430dc9,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd745ae1a-25') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'pci_devices' on Instance uuid fb03897e-7f9e-497a-b703-ca862b11672f {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:36:15 user nova-compute[74295]:   <uuid>fb03897e-7f9e-497a-b703-ca862b11672f</uuid>
Oct 26 06:36:15 user nova-compute[74295]:   <name>instance-00000019</name>
Oct 26 06:36:15 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:36:15 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:36:15 user nova-compute[74295]:   <metadata>
Oct 26 06:36:15 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:36:15 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:36:15 user nova-compute[74295]:       <nova:name>tempest-TestStampPattern-server-474204970</nova:name>
Oct 26 06:36:15 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:36:15</nova:creationTime>
Oct 26 06:36:15 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:36:15 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:36:15 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:36:15 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:36:15 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:36:15 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:36:15 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:36:15 user nova-compute[74295]:       <nova:owner>
Oct 26 06:36:15 user nova-compute[74295]:         <nova:user uuid="5f6d23275c654de1926a7cb988451d10">tempest-TestStampPattern-91727882-project-member</nova:user>
Oct 26 06:36:15 user nova-compute[74295]:         <nova:project uuid="d8af562736824561a4f55f68f27a0b85">tempest-TestStampPattern-91727882</nova:project>
Oct 26 06:36:15 user nova-compute[74295]:       </nova:owner>
Oct 26 06:36:15 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:36:15 user nova-compute[74295]:       <nova:ports>
Oct 26 06:36:15 user nova-compute[74295]:         <nova:port uuid="d745ae1a-25c3-4f4e-bfaa-4462ae430dc9">
Oct 26 06:36:15 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 06:36:15 user nova-compute[74295]:         </nova:port>
Oct 26 06:36:15 user nova-compute[74295]:       </nova:ports>
Oct 26 06:36:15 user nova-compute[74295]:     </nova:instance>
Oct 26 06:36:15 user nova-compute[74295]:   </metadata>
Oct 26 06:36:15 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:36:15 user nova-compute[74295]:     <system>
Oct 26 06:36:15 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:36:15 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:36:15 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:36:15 user nova-compute[74295]:       <entry name="serial">fb03897e-7f9e-497a-b703-ca862b11672f</entry>
Oct 26 06:36:15 user nova-compute[74295]:       <entry name="uuid">fb03897e-7f9e-497a-b703-ca862b11672f</entry>
Oct 26 06:36:15 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:36:15 user nova-compute[74295]:     </system>
Oct 26 06:36:15 user nova-compute[74295]:   </sysinfo>
Oct 26 06:36:15 user nova-compute[74295]:   <os>
Oct 26 06:36:15 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:36:15 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:36:15 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:36:15 user nova-compute[74295]:   </os>
Oct 26 06:36:15 user nova-compute[74295]:   <features>
Oct 26 06:36:15 user nova-compute[74295]:     <acpi/>
Oct 26 06:36:15 user nova-compute[74295]:     <apic/>
Oct 26 06:36:15 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:36:15 user nova-compute[74295]:   </features>
Oct 26 06:36:15 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:36:15 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:36:15 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:36:15 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:36:15 user nova-compute[74295]:   </clock>
Oct 26 06:36:15 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:36:15 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:36:15 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:36:15 user nova-compute[74295]:   </cpu>
Oct 26 06:36:15 user nova-compute[74295]:   <devices>
Oct 26 06:36:15 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:36:15 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:36:15 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk"/>
Oct 26 06:36:15 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:36:15 user nova-compute[74295]:     </disk>
Oct 26 06:36:15 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:36:15 user nova-compute[74295]:       <mac address="fa:16:3e:6f:31:20"/>
Oct 26 06:36:15 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:15 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:36:15 user nova-compute[74295]:       <target dev="tapd745ae1a-25"/>
Oct 26 06:36:15 user nova-compute[74295]:     </interface>
Oct 26 06:36:15 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:36:15 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/console.log" append="off"/>
Oct 26 06:36:15 user nova-compute[74295]:     </serial>
Oct 26 06:36:15 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:36:15 user nova-compute[74295]:     <video>
Oct 26 06:36:15 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:15 user nova-compute[74295]:     </video>
Oct 26 06:36:15 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:36:15 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:36:15 user nova-compute[74295]:     </rng>
Oct 26 06:36:15 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:36:15 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:36:15 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:36:15 user nova-compute[74295]:     </memballoon>
Oct 26 06:36:15 user nova-compute[74295]:   </devices>
Oct 26 06:36:15 user nova-compute[74295]: </domain>
Oct 26 06:36:15 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-474204970',display_name='tempest-TestStampPattern-server-474204970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-474204970',id=25,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEAdKcn8BfIKAadtFceMe64jXIA47ijBG6BK3Cx0+eFXmVCy7VFEkebqDvzRsQ0zTl6IjK9Qm73ynWPZigB9lmyvdFYYVp4BU04c1HSaUw88rA3kLK5vGAV3HV0ee2Bw==',key_name='tempest-TestStampPattern-1605295167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8af562736824561a4f55f68f27a0b85',ramdisk_id='',reservation_id='r-w394cdzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-91727882',owner_user_name='tempest-TestStampPattern-91727882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:36:13Z,user_data=None,user_id='5f6d23275c654de1926a7cb988451d10',uuid=fb03897e-7f9e-497a-b703-ca862b11672f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converting VIF {"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:31:20,bridge_name='br-int',has_traffic_filtering=True,id=d745ae1a-25c3-4f4e-bfaa-4462ae430dc9,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd745ae1a-25') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG os_vif [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:31:20,bridge_name='br-int',has_traffic_filtering=True,id=d745ae1a-25c3-4f4e-bfaa-4462ae430dc9,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd745ae1a-25') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d250349-ffa8-533d-872a-0928c52a55db', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd745ae1a-25, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd745ae1a-25, col_values=(('qos', UUID('e294dc96-b554-41b3-8c80-f8f02bc9d24f')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd745ae1a-25, col_values=(('external_ids', {'iface-id': 'd745ae1a-25c3-4f4e-bfaa-4462ae430dc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:31:20', 'vm-uuid': 'fb03897e-7f9e-497a-b703-ca862b11672f'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:15 user nova-compute[74295]: INFO os_vif [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:31:20,bridge_name='br-int',has_traffic_filtering=True,id=d745ae1a-25c3-4f4e-bfaa-4462ae430dc9,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd745ae1a-25')
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.793s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:36:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No VIF found with MAC fa:16:3e:6f:31:20, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:36:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:36:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:36:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:36:16 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:36:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e806091-49bc-4ad7-abe1-d9ba41dce467 req-b9b6e518-e967-4894-8c27-449d4b794990 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e806091-49bc-4ad7-abe1-d9ba41dce467 req-b9b6e518-e967-4894-8c27-449d4b794990 service nova] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e806091-49bc-4ad7-abe1-d9ba41dce467 req-b9b6e518-e967-4894-8c27-449d4b794990 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e806091-49bc-4ad7-abe1-d9ba41dce467 req-b9b6e518-e967-4894-8c27-449d4b794990 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e806091-49bc-4ad7-abe1-d9ba41dce467 req-b9b6e518-e967-4894-8c27-449d4b794990 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] No waiting events found dispatching network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:17 user nova-compute[74295]: WARNING nova.compute.manager [req-4e806091-49bc-4ad7-abe1-d9ba41dce467 req-b9b6e518-e967-4894-8c27-449d4b794990 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received unexpected event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 for instance with vm_state building and task_state spawning.
Oct 26 06:36:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-a1707e29-2f3f-4fe1-a166-14b18d5f3cfc req-ebea4322-efd6-44df-8be6-ed7bcb19313c service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received event network-changed-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-a1707e29-2f3f-4fe1-a166-14b18d5f3cfc req-ebea4322-efd6-44df-8be6-ed7bcb19313c service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Refreshing instance network info cache due to event network-changed-0feee113-0a27-403b-987a-36375e4f6394. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a1707e29-2f3f-4fe1-a166-14b18d5f3cfc req-ebea4322-efd6-44df-8be6-ed7bcb19313c service nova] Acquiring lock "refresh_cache-89e21688-5d9e-492e-90ce-bf626963e6c5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a1707e29-2f3f-4fe1-a166-14b18d5f3cfc req-ebea4322-efd6-44df-8be6-ed7bcb19313c service nova] Acquired lock "refresh_cache-89e21688-5d9e-492e-90ce-bf626963e6c5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG nova.network.neutron [req-a1707e29-2f3f-4fe1-a166-14b18d5f3cfc req-ebea4322-efd6-44df-8be6-ed7bcb19313c service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Refreshing network info cache for port 0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updating instance_info_cache with network_info: [{"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-b1d6362b-2ffb-4574-8f19-48855f6e7869" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "89e21688-5d9e-492e-90ce-bf626963e6c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:18 user nova-compute[74295]: INFO nova.compute.manager [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Terminating instance
Oct 26 06:36:18 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG nova.network.neutron [req-a1707e29-2f3f-4fe1-a166-14b18d5f3cfc req-ebea4322-efd6-44df-8be6-ed7bcb19313c service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Updated VIF entry in instance network info cache for port 0feee113-0a27-403b-987a-36375e4f6394. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG nova.network.neutron [req-a1707e29-2f3f-4fe1-a166-14b18d5f3cfc req-ebea4322-efd6-44df-8be6-ed7bcb19313c service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Updating instance_info_cache with network_info: [{"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a1707e29-2f3f-4fe1-a166-14b18d5f3cfc req-ebea4322-efd6-44df-8be6-ed7bcb19313c service nova] Releasing lock "refresh_cache-89e21688-5d9e-492e-90ce-bf626963e6c5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:19 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Instance destroyed successfully.
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.objects.instance [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'resources' on Instance uuid 89e21688-5d9e-492e-90ce-bf626963e6c5 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1087427145',display_name='tempest-AttachVolumeNegativeTest-server-1087427145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1087427145',id=21,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkC3sE9FSBgz1PXy0mf8yrmSU8Sy1fT2WIK+5VTW5zF4HOFGW4hLp2XXtVNYfniDSaIib1L5i6prfTJ9On0GliH0ECpywyvP1TU77A7KwXElRXQZ/Qz4iXes8uBRsjmeQ==',key_name='tempest-keypair-1391080014',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:34:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-crc6ay5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=89e21688-5d9e-492e-90ce-bf626963e6c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "0feee113-0a27-403b-987a-36375e4f6394", "address": "fa:16:3e:b8:31:9f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0feee113-0a", "ovs_interfaceid": "0feee113-0a27-403b-987a-36375e4f6394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:9f,bridge_name='br-int',has_traffic_filtering=True,id=0feee113-0a27-403b-987a-36375e4f6394,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0feee113-0a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG os_vif [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:9f,bridge_name='br-int',has_traffic_filtering=True,id=0feee113-0a27-403b-987a-36375e4f6394,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0feee113-0a') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0feee113-0a, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82dd5361-80ef-4603-b275-29f56ebf2657) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:19 user nova-compute[74295]: INFO os_vif [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:31:9f,bridge_name='br-int',has_traffic_filtering=True,id=0feee113-0a27-403b-987a-36375e4f6394,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0feee113-0a')
Oct 26 06:36:19 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Deleting instance files /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5_del
Oct 26 06:36:19 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Deletion of /opt/stack/data/nova/instances/89e21688-5d9e-492e-90ce-bf626963e6c5_del complete
Oct 26 06:36:19 user nova-compute[74295]: INFO nova.compute.manager [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Took 0.78 seconds to destroy the instance on the hypervisor.
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:36:19 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Instance spawned successfully.
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-3739fb5b-2f11-401b-97e0-64afaf9800bc req-049e4694-14a1-4a0d-80e0-e381554177ee service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3739fb5b-2f11-401b-97e0-64afaf9800bc req-049e4694-14a1-4a0d-80e0-e381554177ee service nova] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3739fb5b-2f11-401b-97e0-64afaf9800bc req-049e4694-14a1-4a0d-80e0-e381554177ee service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3739fb5b-2f11-401b-97e0-64afaf9800bc req-049e4694-14a1-4a0d-80e0-e381554177ee service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-3739fb5b-2f11-401b-97e0-64afaf9800bc req-049e4694-14a1-4a0d-80e0-e381554177ee service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] No waiting events found dispatching network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:19 user nova-compute[74295]: WARNING nova.compute.manager [req-3739fb5b-2f11-401b-97e0-64afaf9800bc req-049e4694-14a1-4a0d-80e0-e381554177ee service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received unexpected event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 for instance with vm_state building and task_state spawning.
Oct 26 06:36:19 user nova-compute[74295]: INFO nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Took 6.61 seconds to spawn the instance on the hypervisor.
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received event network-vif-unplugged-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] Acquiring lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] No waiting events found dispatching network-vif-unplugged-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received event network-vif-unplugged-0feee113-0a27-403b-987a-36375e4f6394 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received event network-vif-plugged-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] Acquiring lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] No waiting events found dispatching network-vif-plugged-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:19 user nova-compute[74295]: WARNING nova.compute.manager [req-1b570565-c684-47c0-b870-1463bcb97a6c req-7ca6dec8-fdce-4135-90c6-b48ac336accb service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received unexpected event network-vif-plugged-0feee113-0a27-403b-987a-36375e4f6394 for instance with vm_state active and task_state deleting.
Oct 26 06:36:19 user nova-compute[74295]: INFO nova.compute.manager [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Took 7.83 seconds to build instance.
Oct 26 06:36:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e5842085-e9d6-4d01-bb65-3c7397da95e5 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.978s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:20 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:36:20 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Took 0.95 seconds to deallocate network for instance.
Oct 26 06:36:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:20 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:36:20 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:36:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:20 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Deleted allocations for instance 89e21688-5d9e-492e-90ce-bf626963e6c5
Oct 26 06:36:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0f1dc873-96b5-4b2c-866d-8522b3f2314d tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "89e21688-5d9e-492e-90ce-bf626963e6c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-0a7b16b2-812d-4efa-bbad-5838cc708226 req-a027df8e-c845-4749-ad40-6e5a37ecafe8 service nova] [instance: 89e21688-5d9e-492e-90ce-bf626963e6c5] Received event network-vif-deleted-0feee113-0a27-403b-987a-36375e4f6394 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:36:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Creating image(s)
Oct 26 06:36:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Ensure instance console log exists: /opt/stack/data/nova/instances/5610d9b7-e38f-450b-b395-480c4131f1be/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Start _get_guest_xml network_info=[{"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '3aeb2e6d-f200-41c5-b872-98a73db5a0a6', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxRsyph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5610d9b7-e38f-450b-b395-480c4131f1be', 'attached_at': '', 'detached_at': '', 'volume_id': '66d0f33c-55a7-4dfc-86d0-4c99085b9bda', 'serial': '66d0f33c-55a7-4dfc-86d0-4c99085b9bda'}, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '23ab9504-e6c6-4578-a8bc-078f9180b718', 'boot_index': 1, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpmGwZbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5610d9b7-e38f-450b-b395-480c4131f1be', 'attached_at': '', 'detached_at': '', 'volume_id': '9c9b2dd4-894f-4b15-a2c0-3c6e36466813', 'serial': '9c9b2dd4-894f-4b15-a2c0-3c6e36466813'}, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '34191093-09c3-4101-af0b-8e281d4888a9', 'boot_index': 2, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGpEidMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5610d9b7-e38f-450b-b395-480c4131f1be', 'attached_at': '', 'detached_at': '', 'volume_id': 'df1d4713-afc3-4af5-914a-4f0fdfb8e685', 'serial': 'df1d4713-afc3-4af5-914a-4f0fdfb8e685'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:36:25 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:36:25 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:36:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:36:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxRsyph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:36:26 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:36:26 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:36:26 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d55ddc4-3347-402b-87fa-6b0ad7f9e439]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:36:26 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb0e67c-2add-4097-adf9-54221cb188fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda] added
Oct 26 06:36:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae74973-9597-41c9-b597-50c2da3b5b2c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[16949e89-e574-4832-95a7-e828c124d490]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztxRsyph {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztxRsyph" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fd557d-ea5d-47f7-af34-58e6c49e10f9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztxRsyph'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d90faef-64a0-4af2-ae70-391ffa8be22a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[555fdd82-918e-4098-a805-bd29f6205840]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6bb720-96b8-4e34-a7d7-adbbe8c36cf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda, portal: 172.16.0.220,3260]
Oct 26 06:36:26 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda, portal: 172.16.0.220,3260] successful.
Oct 26 06:36:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc2f60-d59e-4a12-9260-4a83ef84bf21]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb5f72a-dd0d-4fe3-b6de-aa2a05a5ec05]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:26 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea91557-5efe-4be8-a319-9e80f772a04c]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:36:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxRsyph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23565353730333732', 'path': '/dev/sde'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565353730333732', 'path': '/dev/sde'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpmGwZbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:36:27 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:36:27 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:36:27 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c95608e-a719-4bf7-b5cc-fb8565f2b0c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:36:27 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af7b6cc-6e89-4927-ba80-8a0df79c8da0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813] added
Oct 26 06:36:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de3aaf8-9200-4994-8144-26f67acf242e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5418dda0-3426-401f-add9-0add4d25369e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TpmGwZbe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TpmGwZbe" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f5e030-9ba0-4384-a169-2f9070f4594a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TpmGwZbe'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f71d31-d351-4dfa-83e6-f8335e4c4d7c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1071ddd0-9ac2-435e-b4c7-f73f30cac2a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4c0d67-38df-4217-848e-a8c75c0140ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813, portal: 172.16.0.220,3260]
Oct 26 06:36:27 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813, portal: 172.16.0.220,3260] successful.
Oct 26 06:36:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b247e7e1-72cd-4074-8335-1d123d3c5c55]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e9719b-a719-4c70-93ec-055f15296731]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:27 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:36:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9327c3b-ee89-429e-9df4-bded8892d361]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:36:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpmGwZbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23566313430663263', 'path': '/dev/sdf'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566313430663263', 'path': '/dev/sdf'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGpEidMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:36:28 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:36:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:36:28 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:36:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:36:28 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:36:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d0fd2d-6312-4b04-9a4a-70229e0803d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:36:28 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[50539ce5-1491-4557-ba10-23763d650a80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685] added
Oct 26 06:36:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3625e8cd-4aaa-46ca-b03b-1a7e8fdd5271]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7557f318-4c32-498a-b758-ecb7f4341d72]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGpEidMq {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGpEidMq" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d8dcb7-ce17-4ed8-a6fe-e131434e70d4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eGpEidMq'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3414e4d-2793-4378-9681-aafcc684d8f7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c372aca6-5455-43c8-b883-78cd2f4892e7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8172bf30-570c-40c4-a33a-2a1a5a116e2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685, portal: 172.16.0.220,3260]
Oct 26 06:36:29 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685, portal: 172.16.0.220,3260] successful.
Oct 26 06:36:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.074s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[65641461-4e08-4873-b7f7-5a65ed8708fb]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.081s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c37e953-4911-4bda-a4c3-c6799b868441]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:36:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.454s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46adca5-2d90-4db7-a019-e65114f655ea]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:36:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGpEidMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] <== connect_volume: return (1491ms) {'type': 'block', 'scsi_wwn': '26261316666376161', 'path': '/dev/sdg'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261316666376161', 'path': '/dev/sdg'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0f:18,bridge_name='br-int',has_traffic_filtering=True,id=867fc971-1a1f-4258-9543-778eff345dce,network=Network(43f08c11-48d8-4e2a-8859-00969fd21c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867fc971-1a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=077906d1-ce86-449d-ad27-548e2ceaef33,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap077906d1-ce') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:10:f4,bridge_name='br-int',has_traffic_filtering=True,id=09ec26d6-fc41-4da7-8daf-820236267ba0,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09ec26d6-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=72120d2f-c11b-4a8a-82a1-4c1af2c58e05,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72120d2f-c1') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:bd,bridge_name='br-int',has_traffic_filtering=True,id=427ee207-003c-4b88-9dbe-aef3d8c6fade,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ee207-00') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:95:e1,bridge_name='br-int',has_traffic_filtering=True,id=8fd6e395-c8d0-4185-a2a7-a3c251931b91,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd6e395-c8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:2f:36,bridge_name='br-int',has_traffic_filtering=True,id=ecbe87b8-c45d-48d1-8d89-5413dcf9928c,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe87b8-c4') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lazy-loading 'pci_devices' on Instance uuid 5610d9b7-e38f-450b-b395-480c4131f1be {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:36:30 user nova-compute[74295]:   <uuid>5610d9b7-e38f-450b-b395-480c4131f1be</uuid>
Oct 26 06:36:30 user nova-compute[74295]:   <name>instance-00000018</name>
Oct 26 06:36:30 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:36:30 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:36:30 user nova-compute[74295]:   <metadata>
Oct 26 06:36:30 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:36:30 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:36:30 user nova-compute[74295]:       <nova:name>tempest-device-tagging-server-1280211941</nova:name>
Oct 26 06:36:30 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:36:25</nova:creationTime>
Oct 26 06:36:30 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:36:30 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:36:30 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:36:30 user nova-compute[74295]:       <nova:owner>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:user uuid="c43eade49dbf406587ea5ecd09ed131f">tempest-TaggedBootDevicesTest-1275084168-project-member</nova:user>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:project uuid="44b106eb404d4fb7a1f869d6228ff48c">tempest-TaggedBootDevicesTest-1275084168</nova:project>
Oct 26 06:36:30 user nova-compute[74295]:       </nova:owner>
Oct 26 06:36:30 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:36:30 user nova-compute[74295]:       <nova:ports>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:port uuid="867fc971-1a1f-4258-9543-778eff345dce">
Oct 26 06:36:30 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 06:36:30 user nova-compute[74295]:         </nova:port>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:port uuid="077906d1-ce86-449d-ad27-548e2ceaef33">
Oct 26 06:36:30 user nova-compute[74295]:           <nova:ip type="fixed" address="10.1.1.72" ipVersion="4"/>
Oct 26 06:36:30 user nova-compute[74295]:         </nova:port>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:port uuid="09ec26d6-fc41-4da7-8daf-820236267ba0">
Oct 26 06:36:30 user nova-compute[74295]:           <nova:ip type="fixed" address="10.1.1.64" ipVersion="4"/>
Oct 26 06:36:30 user nova-compute[74295]:         </nova:port>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:port uuid="72120d2f-c11b-4a8a-82a1-4c1af2c58e05">
Oct 26 06:36:30 user nova-compute[74295]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Oct 26 06:36:30 user nova-compute[74295]:         </nova:port>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:port uuid="427ee207-003c-4b88-9dbe-aef3d8c6fade">
Oct 26 06:36:30 user nova-compute[74295]:           <nova:ip type="fixed" address="10.1.1.115" ipVersion="4"/>
Oct 26 06:36:30 user nova-compute[74295]:         </nova:port>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:port uuid="8fd6e395-c8d0-4185-a2a7-a3c251931b91">
Oct 26 06:36:30 user nova-compute[74295]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 06:36:30 user nova-compute[74295]:         </nova:port>
Oct 26 06:36:30 user nova-compute[74295]:         <nova:port uuid="ecbe87b8-c45d-48d1-8d89-5413dcf9928c">
Oct 26 06:36:30 user nova-compute[74295]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 06:36:30 user nova-compute[74295]:         </nova:port>
Oct 26 06:36:30 user nova-compute[74295]:       </nova:ports>
Oct 26 06:36:30 user nova-compute[74295]:     </nova:instance>
Oct 26 06:36:30 user nova-compute[74295]:   </metadata>
Oct 26 06:36:30 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:36:30 user nova-compute[74295]:     <system>
Oct 26 06:36:30 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:36:30 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:36:30 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:36:30 user nova-compute[74295]:       <entry name="serial">5610d9b7-e38f-450b-b395-480c4131f1be</entry>
Oct 26 06:36:30 user nova-compute[74295]:       <entry name="uuid">5610d9b7-e38f-450b-b395-480c4131f1be</entry>
Oct 26 06:36:30 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:36:30 user nova-compute[74295]:     </system>
Oct 26 06:36:30 user nova-compute[74295]:   </sysinfo>
Oct 26 06:36:30 user nova-compute[74295]:   <os>
Oct 26 06:36:30 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:36:30 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:36:30 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:36:30 user nova-compute[74295]:   </os>
Oct 26 06:36:30 user nova-compute[74295]:   <features>
Oct 26 06:36:30 user nova-compute[74295]:     <acpi/>
Oct 26 06:36:30 user nova-compute[74295]:     <apic/>
Oct 26 06:36:30 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:36:30 user nova-compute[74295]:   </features>
Oct 26 06:36:30 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:36:30 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:36:30 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:36:30 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:36:30 user nova-compute[74295]:   </clock>
Oct 26 06:36:30 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:36:30 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:36:30 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:36:30 user nova-compute[74295]:   </cpu>
Oct 26 06:36:30 user nova-compute[74295]:   <devices>
Oct 26 06:36:30 user nova-compute[74295]:     <disk type="file" device="cdrom">
Oct 26 06:36:30 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 06:36:30 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/5610d9b7-e38f-450b-b395-480c4131f1be/disk.config"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="hda" bus="ide"/>
Oct 26 06:36:30 user nova-compute[74295]:     </disk>
Oct 26 06:36:30 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:36:30 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:36:30 user nova-compute[74295]:       <source dev="/dev/sde"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <serial>66d0f33c-55a7-4dfc-86d0-4c99085b9bda</serial>
Oct 26 06:36:30 user nova-compute[74295]:     </disk>
Oct 26 06:36:30 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:36:30 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:36:30 user nova-compute[74295]:       <source dev="/dev/sdf"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <serial>9c9b2dd4-894f-4b15-a2c0-3c6e36466813</serial>
Oct 26 06:36:30 user nova-compute[74295]:     </disk>
Oct 26 06:36:30 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:36:30 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:36:30 user nova-compute[74295]:       <source dev="/dev/sdg"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="vdc" bus="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <serial>df1d4713-afc3-4af5-914a-4f0fdfb8e685</serial>
Oct 26 06:36:30 user nova-compute[74295]:     </disk>
Oct 26 06:36:30 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:36:30 user nova-compute[74295]:       <mac address="fa:16:3e:ce:0f:18"/>
Oct 26 06:36:30 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="tap867fc971-1a"/>
Oct 26 06:36:30 user nova-compute[74295]:     </interface>
Oct 26 06:36:30 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:36:30 user nova-compute[74295]:       <mac address="fa:16:3e:29:1d:d2"/>
Oct 26 06:36:30 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="tap077906d1-ce"/>
Oct 26 06:36:30 user nova-compute[74295]:     </interface>
Oct 26 06:36:30 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:36:30 user nova-compute[74295]:       <mac address="fa:16:3e:62:10:f4"/>
Oct 26 06:36:30 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="tap09ec26d6-fc"/>
Oct 26 06:36:30 user nova-compute[74295]:     </interface>
Oct 26 06:36:30 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:36:30 user nova-compute[74295]:       <mac address="fa:16:3e:fa:e6:ec"/>
Oct 26 06:36:30 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="tap72120d2f-c1"/>
Oct 26 06:36:30 user nova-compute[74295]:     </interface>
Oct 26 06:36:30 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:36:30 user nova-compute[74295]:       <mac address="fa:16:3e:7a:97:bd"/>
Oct 26 06:36:30 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="tap427ee207-00"/>
Oct 26 06:36:30 user nova-compute[74295]:     </interface>
Oct 26 06:36:30 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:36:30 user nova-compute[74295]:       <mac address="fa:16:3e:26:95:e1"/>
Oct 26 06:36:30 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="tap8fd6e395-c8"/>
Oct 26 06:36:30 user nova-compute[74295]:     </interface>
Oct 26 06:36:30 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:36:30 user nova-compute[74295]:       <mac address="fa:16:3e:33:2f:36"/>
Oct 26 06:36:30 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:36:30 user nova-compute[74295]:       <target dev="tapecbe87b8-c4"/>
Oct 26 06:36:30 user nova-compute[74295]:     </interface>
Oct 26 06:36:30 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:36:30 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/5610d9b7-e38f-450b-b395-480c4131f1be/console.log" append="off"/>
Oct 26 06:36:30 user nova-compute[74295]:     </serial>
Oct 26 06:36:30 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:36:30 user nova-compute[74295]:     <video>
Oct 26 06:36:30 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:36:30 user nova-compute[74295]:     </video>
Oct 26 06:36:30 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:36:30 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:36:30 user nova-compute[74295]:     </rng>
Oct 26 06:36:30 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:36:30 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:36:30 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:36:30 user nova-compute[74295]:     </memballoon>
Oct 26 06:36:30 user nova-compute[74295]:   </devices>
Oct 26 06:36:30 user nova-compute[74295]: </domain>
Oct 26 06:36:30 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0f:18,bridge_name='br-int',has_traffic_filtering=True,id=867fc971-1a1f-4258-9543-778eff345dce,network=Network(43f08c11-48d8-4e2a-8859-00969fd21c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867fc971-1a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0f:18,bridge_name='br-int',has_traffic_filtering=True,id=867fc971-1a1f-4258-9543-778eff345dce,network=Network(43f08c11-48d8-4e2a-8859-00969fd21c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867fc971-1a') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91c33cdc-1d86-59ae-a5f1-f0651c75b373', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap867fc971-1a, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap867fc971-1a, col_values=(('qos', UUID('b7f9a74b-5a87-4060-9bc1-3f07e4d694ba')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap867fc971-1a, col_values=(('external_ids', {'iface-id': '867fc971-1a1f-4258-9543-778eff345dce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:0f:18', 'vm-uuid': '5610d9b7-e38f-450b-b395-480c4131f1be'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: INFO os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0f:18,bridge_name='br-int',has_traffic_filtering=True,id=867fc971-1a1f-4258-9543-778eff345dce,network=Network(43f08c11-48d8-4e2a-8859-00969fd21c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867fc971-1a')
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=077906d1-ce86-449d-ad27-548e2ceaef33,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap077906d1-ce') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=077906d1-ce86-449d-ad27-548e2ceaef33,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap077906d1-ce') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '599f72f5-27cd-52a5-bd7f-095b6bc58ff9', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap077906d1-ce, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap077906d1-ce, col_values=(('qos', UUID('3bc7d0d2-7884-4c1a-80ec-1270fc7c8ecf')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap077906d1-ce, col_values=(('external_ids', {'iface-id': '077906d1-ce86-449d-ad27-548e2ceaef33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:1d:d2', 'vm-uuid': '5610d9b7-e38f-450b-b395-480c4131f1be'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: INFO os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=077906d1-ce86-449d-ad27-548e2ceaef33,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap077906d1-ce')
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:10:f4,bridge_name='br-int',has_traffic_filtering=True,id=09ec26d6-fc41-4da7-8daf-820236267ba0,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09ec26d6-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:10:f4,bridge_name='br-int',has_traffic_filtering=True,id=09ec26d6-fc41-4da7-8daf-820236267ba0,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09ec26d6-fc') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6cd88ea-35e5-5e8d-bdde-650ae7b096cf', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09ec26d6-fc, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09ec26d6-fc, col_values=(('qos', UUID('41b7027b-5a3f-4a0e-b412-dde0461c4c57')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09ec26d6-fc, col_values=(('external_ids', {'iface-id': '09ec26d6-fc41-4da7-8daf-820236267ba0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:10:f4', 'vm-uuid': '5610d9b7-e38f-450b-b395-480c4131f1be'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: INFO os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:10:f4,bridge_name='br-int',has_traffic_filtering=True,id=09ec26d6-fc41-4da7-8daf-820236267ba0,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09ec26d6-fc')
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=72120d2f-c11b-4a8a-82a1-4c1af2c58e05,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72120d2f-c1') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=72120d2f-c11b-4a8a-82a1-4c1af2c58e05,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72120d2f-c1') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e7d3b34-d301-5d6b-b5f3-eb4eb7d142e9', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72120d2f-c1, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72120d2f-c1, col_values=(('qos', UUID('4eec4a18-18e5-474d-b11d-c717633165ab')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72120d2f-c1, col_values=(('external_ids', {'iface-id': '72120d2f-c11b-4a8a-82a1-4c1af2c58e05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:e6:ec', 'vm-uuid': '5610d9b7-e38f-450b-b395-480c4131f1be'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: INFO os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=72120d2f-c11b-4a8a-82a1-4c1af2c58e05,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72120d2f-c1')
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:bd,bridge_name='br-int',has_traffic_filtering=True,id=427ee207-003c-4b88-9dbe-aef3d8c6fade,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ee207-00') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:bd,bridge_name='br-int',has_traffic_filtering=True,id=427ee207-003c-4b88-9dbe-aef3d8c6fade,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ee207-00') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ff07b3c-06a8-5907-b8a6-a4e33298a533', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap427ee207-00, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap427ee207-00, col_values=(('qos', UUID('7daf9eb6-f2ec-44df-bde2-848d56633043')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap427ee207-00, col_values=(('external_ids', {'iface-id': '427ee207-003c-4b88-9dbe-aef3d8c6fade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:97:bd', 'vm-uuid': '5610d9b7-e38f-450b-b395-480c4131f1be'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: INFO os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:bd,bridge_name='br-int',has_traffic_filtering=True,id=427ee207-003c-4b88-9dbe-aef3d8c6fade,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ee207-00')
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:95:e1,bridge_name='br-int',has_traffic_filtering=True,id=8fd6e395-c8d0-4185-a2a7-a3c251931b91,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd6e395-c8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:95:e1,bridge_name='br-int',has_traffic_filtering=True,id=8fd6e395-c8d0-4185-a2a7-a3c251931b91,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd6e395-c8') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43b9f4ad-8012-5d7f-a810-fbd5b08180c7', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fd6e395-c8, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fd6e395-c8, col_values=(('qos', UUID('b7fad9c0-9a18-4e45-886e-34e17e94651a')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fd6e395-c8, col_values=(('external_ids', {'iface-id': '8fd6e395-c8d0-4185-a2a7-a3c251931b91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:95:e1', 'vm-uuid': '5610d9b7-e38f-450b-b395-480c4131f1be'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:31 user nova-compute[74295]: INFO os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:95:e1,bridge_name='br-int',has_traffic_filtering=True,id=8fd6e395-c8d0-4185-a2a7-a3c251931b91,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd6e395-c8')
Oct 26 06:36:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:2f:36,bridge_name='br-int',has_traffic_filtering=True,id=ecbe87b8-c45d-48d1-8d89-5413dcf9928c,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe87b8-c4') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:2f:36,bridge_name='br-int',has_traffic_filtering=True,id=ecbe87b8-c45d-48d1-8d89-5413dcf9928c,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe87b8-c4') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd74a9d39-91a4-5b1b-b935-49e123c9cc4b', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecbe87b8-c4, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecbe87b8-c4, col_values=(('qos', UUID('d91efc17-1357-456c-8cfe-3e9f80e6fcfe')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecbe87b8-c4, col_values=(('external_ids', {'iface-id': 'ecbe87b8-c45d-48d1-8d89-5413dcf9928c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:2f:36', 'vm-uuid': '5610d9b7-e38f-450b-b395-480c4131f1be'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:31 user nova-compute[74295]: INFO os_vif [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:2f:36,bridge_name='br-int',has_traffic_filtering=True,id=ecbe87b8-c45d-48d1-8d89-5413dcf9928c,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe87b8-c4')
Oct 26 06:36:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] No BDM found with device name hda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] No VIF found with MAC fa:16:3e:ce:0f:18, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] No VIF found with MAC fa:16:3e:7a:97:bd, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:36:31 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Using config drive
Oct 26 06:36:31 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Creating config drive at /opt/stack/data/nova/instances/5610d9b7-e38f-450b-b395-480c4131f1be/disk.config
Oct 26 06:36:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5610d9b7-e38f-450b-b395-480c4131f1be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe0uh1mgi {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5610d9b7-e38f-450b-b395-480c4131f1be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe0uh1mgi" returned: 0 in 0.059s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-530a46cb-7621-4c1f-b040-d3e4411efb92 req-5cb58534-c211-4885-9d2c-f3329cc898b8 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-530a46cb-7621-4c1f-b040-d3e4411efb92 req-5cb58534-c211-4885-9d2c-f3329cc898b8 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-530a46cb-7621-4c1f-b040-d3e4411efb92 req-5cb58534-c211-4885-9d2c-f3329cc898b8 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-530a46cb-7621-4c1f-b040-d3e4411efb92 req-5cb58534-c211-4885-9d2c-f3329cc898b8 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-530a46cb-7621-4c1f-b040-d3e4411efb92 req-5cb58534-c211-4885-9d2c-f3329cc898b8 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:33 user nova-compute[74295]: WARNING nova.compute.manager [req-530a46cb-7621-4c1f-b040-d3e4411efb92 req-5cb58534-c211-4885-9d2c-f3329cc898b8 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-867fc971-1a1f-4258-9543-778eff345dce for instance with vm_state building and task_state spawning.
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: INFO nova.compute.manager [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] instance snapshotting
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Beginning live snapshot process
Oct 26 06:36:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-d5da9cce-cc81-4fe9-a6b4-5e10f80542a6 req-98f2bcf5-1f57-4701-868a-03be479854b8 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d5da9cce-cc81-4fe9-a6b4-5e10f80542a6 req-98f2bcf5-1f57-4701-868a-03be479854b8 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d5da9cce-cc81-4fe9-a6b4-5e10f80542a6 req-98f2bcf5-1f57-4701-868a-03be479854b8 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d5da9cce-cc81-4fe9-a6b4-5e10f80542a6 req-98f2bcf5-1f57-4701-868a-03be479854b8 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-d5da9cce-cc81-4fe9-a6b4-5e10f80542a6 req-98f2bcf5-1f57-4701-868a-03be479854b8 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:34 user nova-compute[74295]: WARNING nova.compute.manager [req-d5da9cce-cc81-4fe9-a6b4-5e10f80542a6 req-98f2bcf5-1f57-4701-868a-03be479854b8 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-077906d1-ce86-449d-ad27-548e2ceaef33 for instance with vm_state building and task_state spawning.
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json -f qcow2 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-51607980-1d89-45b5-9f42-c5bc1a1f9e35 req-9951ed47-7820-4239-a9fd-28dcd978a895 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-51607980-1d89-45b5-9f42-c5bc1a1f9e35 req-9951ed47-7820-4239-a9fd-28dcd978a895 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-51607980-1d89-45b5-9f42-c5bc1a1f9e35 req-9951ed47-7820-4239-a9fd-28dcd978a895 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-51607980-1d89-45b5-9f42-c5bc1a1f9e35 req-9951ed47-7820-4239-a9fd-28dcd978a895 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-51607980-1d89-45b5-9f42-c5bc1a1f9e35 req-9951ed47-7820-4239-a9fd-28dcd978a895 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:34 user nova-compute[74295]: WARNING nova.compute.manager [req-51607980-1d89-45b5-9f42-c5bc1a1f9e35 req-9951ed47-7820-4239-a9fd-28dcd978a895 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-09ec26d6-fc41-4da7-8daf-820236267ba0 for instance with vm_state building and task_state spawning.
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json -f qcow2" returned: 0 in 0.247s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json -f qcow2 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json -f qcow2" returned: 0 in 0.225s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.205s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplhl14dj9/68ea74f6c0bf48ffa4131e9ea41109bf.delta 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplhl14dj9/68ea74f6c0bf48ffa4131e9ea41109bf.delta 1073741824" returned: 0 in 0.072s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:35 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:35 user nova-compute[74295]: WARNING nova.compute.manager [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-867fc971-1a1f-4258-9543-778eff345dce for instance with vm_state building and task_state spawning.
Oct 26 06:36:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:35 user nova-compute[74295]: WARNING nova.compute.manager [req-3b4cd05b-a0d1-47a3-ac9d-beae0d7ed844 req-3392cdab-6d9c-42e1-b9cc-2bd9bcd6d580 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 for instance with vm_state building and task_state spawning.
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:36 user nova-compute[74295]: WARNING nova.compute.manager [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-077906d1-ce86-449d-ad27-548e2ceaef33 for instance with vm_state building and task_state spawning.
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:36 user nova-compute[74295]: WARNING nova.compute.manager [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c for instance with vm_state building and task_state spawning.
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:36 user nova-compute[74295]: WARNING nova.compute.manager [req-88c7990e-49c6-47fd-8020-466a57f69d34 req-46374537-596d-49ba-98e1-1cf49c2e927f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c for instance with vm_state building and task_state spawning.
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:36 user nova-compute[74295]: WARNING nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-09ec26d6-fc41-4da7-8daf-820236267ba0 for instance with vm_state building and task_state spawning.
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:36 user nova-compute[74295]: WARNING nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 for instance with vm_state building and task_state spawning.
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:36 user nova-compute[74295]: WARNING nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 for instance with vm_state building and task_state spawning.
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:36 user nova-compute[74295]: WARNING nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-427ee207-003c-4b88-9dbe-aef3d8c6fade for instance with vm_state building and task_state spawning.
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:36 user nova-compute[74295]: WARNING nova.compute.manager [req-a0b4b388-1c01-4570-ba64-cafd839a2ab6 req-e2e774b6-b36a-4d15-aacf-ddf1391ea0d1 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-427ee207-003c-4b88-9dbe-aef3d8c6fade for instance with vm_state building and task_state spawning.
Oct 26 06:36:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] COPY block job progress, current cursor: 21889024 final cursor: 75497472 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:36:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 06:36:37 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:36:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplhl14dj9/68ea74f6c0bf48ffa4131e9ea41109bf.delta /opt/stack/data/nova/instances/snapshots/tmplhl14dj9/68ea74f6c0bf48ffa4131e9ea41109bf {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-c124e269-bf5d-4429-866c-f9b775015599 req-001735b1-f875-4e7e-a9e4-cef8fd465632 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c124e269-bf5d-4429-866c-f9b775015599 req-001735b1-f875-4e7e-a9e4-cef8fd465632 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c124e269-bf5d-4429-866c-f9b775015599 req-001735b1-f875-4e7e-a9e4-cef8fd465632 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c124e269-bf5d-4429-866c-f9b775015599 req-001735b1-f875-4e7e-a9e4-cef8fd465632 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-c124e269-bf5d-4429-866c-f9b775015599 req-001735b1-f875-4e7e-a9e4-cef8fd465632 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:36:37 user nova-compute[74295]: WARNING nova.compute.manager [req-c124e269-bf5d-4429-866c-f9b775015599 req-001735b1-f875-4e7e-a9e4-cef8fd465632 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 for instance with vm_state building and task_state spawning.
Oct 26 06:36:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplhl14dj9/68ea74f6c0bf48ffa4131e9ea41109bf.delta /opt/stack/data/nova/instances/snapshots/tmplhl14dj9/68ea74f6c0bf48ffa4131e9ea41109bf" returned: 0 in 0.614s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Snapshot extracted, beginning image upload
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:36:38 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance spawned successfully.
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:36:38 user nova-compute[74295]: INFO nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Took 12.79 seconds to spawn the instance on the hypervisor.
Oct 26 06:36:38 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:36:38 user nova-compute[74295]: INFO nova.compute.manager [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Took 105.82 seconds to build instance.
Oct 26 06:36:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e9c07bb5-c0bc-41af-92fc-33fb8437eb28 tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "5610d9b7-e38f-450b-b395-480c4131f1be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 105.940s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-e5b5a07c-9cd6-489c-9a8b-f70aa3a86034 req-4bc5957a-b15d-43be-983e-a2d2357351db service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-changed-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-e5b5a07c-9cd6-489c-9a8b-f70aa3a86034 req-4bc5957a-b15d-43be-983e-a2d2357351db service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Refreshing instance network info cache due to event network-changed-775a3f05-426c-473c-a0ce-499522370ef9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e5b5a07c-9cd6-489c-9a8b-f70aa3a86034 req-4bc5957a-b15d-43be-983e-a2d2357351db service nova] Acquiring lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e5b5a07c-9cd6-489c-9a8b-f70aa3a86034 req-4bc5957a-b15d-43be-983e-a2d2357351db service nova] Acquired lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG nova.network.neutron [req-e5b5a07c-9cd6-489c-9a8b-f70aa3a86034 req-4bc5957a-b15d-43be-983e-a2d2357351db service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Refreshing network info cache for port 775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG nova.objects.instance [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'flavor' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:36:39 user nova-compute[74295]: INFO nova.compute.manager [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Attaching volume e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc to /dev/vdb
Oct 26 06:36:39 user nova-compute[74295]: DEBUG os_brick.utils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a959b98-18e5-4945-9e75-69f236dd3c31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6929fb47-a563-43c7-8a0b-c66bb3556d1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[758ceeaa-2e24-46ba-be7a-ca688732e457]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2e20df-02bb-4ae9-b9da-f7a6abb50c8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:36:39 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:36:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7ecc8c-da63-49b1-a7dc-899fd6f10a52]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG os_brick.utils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:36:39 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updating existing volume attachment record: bac38918-30f9-420a-b15d-79bf51532f9c {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:36:40 user nova-compute[74295]: DEBUG nova.network.neutron [req-e5b5a07c-9cd6-489c-9a8b-f70aa3a86034 req-4bc5957a-b15d-43be-983e-a2d2357351db service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updated VIF entry in instance network info cache for port 775a3f05-426c-473c-a0ce-499522370ef9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:36:40 user nova-compute[74295]: DEBUG nova.network.neutron [req-e5b5a07c-9cd6-489c-9a8b-f70aa3a86034 req-4bc5957a-b15d-43be-983e-a2d2357351db service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updating instance_info_cache with network_info: [{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:36:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e5b5a07c-9cd6-489c-9a8b-f70aa3a86034 req-4bc5957a-b15d-43be-983e-a2d2357351db service nova] Releasing lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:36:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Snapshot image upload complete
Oct 26 06:36:40 user nova-compute[74295]: INFO nova.compute.manager [None req-e1d5da63-b224-4798-b326-50ce65e10971 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Took 6.59 seconds to snapshot the instance on the hypervisor.
Oct 26 06:36:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:36:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:00 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 06:37:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 06:37:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:05 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:06 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:06 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 06:37:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:07 user nova-compute[74295]: INFO nova.compute.manager [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Terminating instance
Oct 26 06:37:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:37:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e52d328-7cd5-49c9-a1ac-338a84104de8 req-46af40d8-7128-4fee-9a8b-1617ce75cc7b service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received event network-vif-unplugged-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e52d328-7cd5-49c9-a1ac-338a84104de8 req-46af40d8-7128-4fee-9a8b-1617ce75cc7b service nova] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e52d328-7cd5-49c9-a1ac-338a84104de8 req-46af40d8-7128-4fee-9a8b-1617ce75cc7b service nova] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e52d328-7cd5-49c9-a1ac-338a84104de8 req-46af40d8-7128-4fee-9a8b-1617ce75cc7b service nova] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e52d328-7cd5-49c9-a1ac-338a84104de8 req-46af40d8-7128-4fee-9a8b-1617ce75cc7b service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] No waiting events found dispatching network-vif-unplugged-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e52d328-7cd5-49c9-a1ac-338a84104de8 req-46af40d8-7128-4fee-9a8b-1617ce75cc7b service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received event network-vif-unplugged-3a25550b-3555-4da8-81b1-8510844fc8ec for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:37:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Instance destroyed successfully.
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lazy-loading 'resources' on Instance uuid b1f13ee5-22e7-466c-a117-ae4a707ad2bc {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-166092043',display_name='tempest-TestVolumeSwap-server-166092043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-166092043',id=16,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQWaT81crNUyJOINzc4X8Jp9xQ/W8we72QGFBnb+X6LK91FfOWnu6kpdGA4JQeCMEwXz5pi+0KJUwjTe6icVA6gQiVuAaKaACr9RjtY3gwfHWZQr/SETLFTfpmbLE8+ow==',key_name='tempest-keypair-701294580',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:31:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a6f09cde7274f9d84c09303f90b7e57',ramdisk_id='',reservation_id='r-8piwvzgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2032701720',owner_user_name='tempest-TestVolumeSwap-2032701720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:31:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c04fd24cda04bb68280748d9588d289',uuid=b1f13ee5-22e7-466c-a117-ae4a707ad2bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Converting VIF {"id": "3a25550b-3555-4da8-81b1-8510844fc8ec", "address": "fa:16:3e:82:35:94", "network": {"id": "de5a46e9-64a7-47b5-8d16-d1e81d21db18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1092300249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a6f09cde7274f9d84c09303f90b7e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a25550b-35", "ovs_interfaceid": "3a25550b-3555-4da8-81b1-8510844fc8ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:35:94,bridge_name='br-int',has_traffic_filtering=True,id=3a25550b-3555-4da8-81b1-8510844fc8ec,network=Network(de5a46e9-64a7-47b5-8d16-d1e81d21db18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a25550b-35') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_vif [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:35:94,bridge_name='br-int',has_traffic_filtering=True,id=3a25550b-3555-4da8-81b1-8510844fc8ec,network=Network(de5a46e9-64a7-47b5-8d16-d1e81d21db18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a25550b-35') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a25550b-35, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79e1c781-a273-47c2-acc6-565f3782764a) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:08 user nova-compute[74295]: INFO os_vif [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:35:94,bridge_name='br-int',has_traffic_filtering=True,id=3a25550b-3555-4da8-81b1-8510844fc8ec,network=Network(de5a46e9-64a7-47b5-8d16-d1e81d21db18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a25550b-35')
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLKeJjpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'cac15c48-249b-4680-937f-d2ca8845d0f8'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:37:08 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f1494a-6277-429a-aa0b-aec2c39eceb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:37:08 user nova-compute[74295]: No targets found.
Oct 26 06:37:08 user nova-compute[74295]: iSNS:
Oct 26 06:37:08 user nova-compute[74295]: No targets found.
Oct 26 06:37:08 user nova-compute[74295]: STATIC:
Oct 26 06:37:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8
Oct 26 06:37:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9
Oct 26 06:37:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813
Oct 26 06:37:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685
Oct 26 06:37:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f
Oct 26 06:37:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:37:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda
Oct 26 06:37:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:08 user nova-compute[74295]: FIRMWARE:
Oct 26 06:37:08 user nova-compute[74295]: No targets found.
Oct 26 06:37:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:37:08 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:37:08 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239c94b-4406-499e-9ea5-23b8c6857474]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e5bd6-9090-4de5-948c-5b24879b2c1e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac7484c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8'): ({'sdh'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Removing single pathed devices sdh {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c05e7c-b724-4d40-ad81-2a94c8485ac9]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bff862-939e-44eb-95f8-a06ddbb34921]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Flushing IO for device /dev/sdh {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[61633f78-1087-4224-ad80-4f6632cd1db7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f3f3c2-7389-43a3-94c0-24fe4dce0156]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] SCSI volumes sdh have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6e141e-5c3d-4ea5-a6e9-be4330d23b3d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f2454a-233b-4b4c-8040-e7d1f43f0b4a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8, portal: 172.16.0.220,3260]
Oct 26 06:37:08 user nova-compute[74295]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8, portal: 172.16.0.220,3260] successful.
Oct 26 06:37:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac15c48-249b-4680-937f-d2ca8845d0f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a32ff3-260b-491c-8af0-e58259cd4c73]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] <== disconnect_volume: return (341ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:37:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:37:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Deleting instance files /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc_del
Oct 26 06:37:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Deletion of /opt/stack/data/nova/instances/b1f13ee5-22e7-466c-a117-ae4a707ad2bc_del complete
Oct 26 06:37:09 user nova-compute[74295]: INFO nova.compute.manager [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 26 06:37:09 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:37:09 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:37:09 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:37:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:37:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.compute.manager [req-1501fc0f-6fa0-4de8-b219-dd9be9d0066f req-1fbe56a7-efd4-4bbe-8a7f-78a6de08a31d service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received event network-vif-plugged-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1501fc0f-6fa0-4de8-b219-dd9be9d0066f req-1fbe56a7-efd4-4bbe-8a7f-78a6de08a31d service nova] Acquiring lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1501fc0f-6fa0-4de8-b219-dd9be9d0066f req-1fbe56a7-efd4-4bbe-8a7f-78a6de08a31d service nova] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1501fc0f-6fa0-4de8-b219-dd9be9d0066f req-1fbe56a7-efd4-4bbe-8a7f-78a6de08a31d service nova] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.compute.manager [req-1501fc0f-6fa0-4de8-b219-dd9be9d0066f req-1fbe56a7-efd4-4bbe-8a7f-78a6de08a31d service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] No waiting events found dispatching network-vif-plugged-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:37:10 user nova-compute[74295]: WARNING nova.compute.manager [req-1501fc0f-6fa0-4de8-b219-dd9be9d0066f req-1fbe56a7-efd4-4bbe-8a7f-78a6de08a31d service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received unexpected event network-vif-plugged-3a25550b-3555-4da8-81b1-8510844fc8ec for instance with vm_state active and task_state deleting.
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.compute.manager [req-fc5fe831-ab08-4503-8b7a-f454d2d2b43c req-120f6a05-736a-4359-a150-cbfa5994728d service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Received event network-vif-deleted-3a25550b-3555-4da8-81b1-8510844fc8ec {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:10 user nova-compute[74295]: INFO nova.compute.manager [req-fc5fe831-ab08-4503-8b7a-f454d2d2b43c req-120f6a05-736a-4359-a150-cbfa5994728d service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Neutron deleted interface 3a25550b-3555-4da8-81b1-8510844fc8ec; detaching it from the instance and deleting it from the info cache
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.network.neutron [req-fc5fe831-ab08-4503-8b7a-f454d2d2b43c req-120f6a05-736a-4359-a150-cbfa5994728d service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:37:10 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Took 1.12 seconds to deallocate network for instance.
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.compute.manager [req-fc5fe831-ab08-4503-8b7a-f454d2d2b43c req-120f6a05-736a-4359-a150-cbfa5994728d service nova] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Detach interface failed, port_id=3a25550b-3555-4da8-81b1-8510844fc8ec, reason: Instance b1f13ee5-22e7-466c-a117-ae4a707ad2bc could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:10 user nova-compute[74295]: INFO nova.compute.manager [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Detaching volume fc733cb5-132f-4e4d-8276-6c468866b1d9
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:10 user nova-compute[74295]: INFO nova.virt.block_device [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Attempting to driver detach volume fc733cb5-132f-4e4d-8276-6c468866b1d9 from mountpoint /dev/vdb
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Attempting to detach device vdb from instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:37:10 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:37:10 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:37:10 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:37:10 user nova-compute[74295]:   <serial>fc733cb5-132f-4e4d-8276-6c468866b1d9</serial>
Oct 26 06:37:10 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:37:10 user nova-compute[74295]: </disk>
Oct 26 06:37:10 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:37:10 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully detached device vdb from instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d from the persistent domain config.
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:37:10 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:37:10 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:37:10 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:37:10 user nova-compute[74295]:   <serial>fc733cb5-132f-4e4d-8276-6c468866b1d9</serial>
Oct 26 06:37:10 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:37:10 user nova-compute[74295]: </disk>
Oct 26 06:37:10 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: INFO nova.compute.manager [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] [instance: b1f13ee5-22e7-466c-a117-ae4a707ad2bc] Took 1.05 seconds to detach 1 volumes for instance.
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDUPAapz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:37:11 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:37:11 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:37:11 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a509e3-47a7-42fb-88e4-3c062ecc7a0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:37:11 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bb9cfe-75c7-4ecd-b779-0ef890f1f083]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc] added
Oct 26 06:37:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f76a395-3a72-4638-a214-19d142a0876a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[936eb2ba-8cce-40ea-a91e-9b1a5a8ad954]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XDUPAapz {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XDUPAapz" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704c8e9-b2b9-443e-b93e-e5c23b0ac7bd]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XDUPAapz'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fab707-0bcb-4e6f-aa11-5de767b8f015]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d8d6db-cd5a-47e7-8a0e-33b1dbf02c50]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.615s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[da28f266-3826-4bdc-a7d7-fa4b8c5287e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc, portal: 172.16.0.220,3260]
Oct 26 06:37:11 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc, portal: 172.16.0.220,3260] successful.
Oct 26 06:37:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75e9806-0dc4-49d4-9567-17e9bc92de63]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f013ef-7379-462f-bdbb-1c0497e300cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:37:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:11 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:37:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] HCTL ('39', '-', '-', 0) found on session 27 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:37:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:12 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Deleted allocations for instance b1f13ee5-22e7-466c-a117-ae4a707ad2bc
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c71b7dc-97a5-4df7-8e6e-f3b15abcfe2f]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching for a device in session 27 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDUPAapz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8015476-d600-4dfd-b19c-f99536c396ac tempest-TestVolumeSwap-2032701720 tempest-TestVolumeSwap-2032701720-project-member] Lock "b1f13ee5-22e7-466c-a117-ae4a707ad2bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.397s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] <== connect_volume: return (1507ms) {'type': 'block', 'scsi_wwn': '23733336636616433', 'path': '/dev/sdh'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733336636616433', 'path': '/dev/sdh'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG nova.objects.instance [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'flavor' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:37:13 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:37:13 user nova-compute[74295]:   <source dev="/dev/sdh"/>
Oct 26 06:37:13 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:37:13 user nova-compute[74295]:   <serial>e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc</serial>
Oct 26 06:37:13 user nova-compute[74295]: </disk>
Oct 26 06:37:13 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No VIF found with MAC fa:16:3e:a1:3f:72, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-37b6c16f-deb0-4393-9182-011c8af6388a tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.253s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:37:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7238MB free_disk=25.222095489501953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:14 user nova-compute[74295]: INFO nova.compute.manager [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Rescuing
Oct 26 06:37:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquired lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 0440536c-c9ad-439e-aa26-689b945c63ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 6b441689-7c38-455d-a55e-6cd9615049cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d6c25b84-4b35-4086-89a5-d5f2823b507a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 5610d9b7-e38f-450b-b395-480c4131f1be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fb03897e-7f9e-497a-b703-ca862b11672f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updating instance_info_cache with network_info: [{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Releasing lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-cfbbd3dd-0fa2-4644-8684-e26642cf24e1 req-859b9a18-672d-45b2-8134-482eaad6de7b service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-unplugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cfbbd3dd-0fa2-4644-8684-e26642cf24e1 req-859b9a18-672d-45b2-8134-482eaad6de7b service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cfbbd3dd-0fa2-4644-8684-e26642cf24e1 req-859b9a18-672d-45b2-8134-482eaad6de7b service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cfbbd3dd-0fa2-4644-8684-e26642cf24e1 req-859b9a18-672d-45b2-8134-482eaad6de7b service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-cfbbd3dd-0fa2-4644-8684-e26642cf24e1 req-859b9a18-672d-45b2-8134-482eaad6de7b service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-unplugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:37:15 user nova-compute[74295]: WARNING nova.compute.manager [req-cfbbd3dd-0fa2-4644-8684-e26642cf24e1 req-859b9a18-672d-45b2-8134-482eaad6de7b service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-unplugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state active and task_state rescuing.
Oct 26 06:37:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Instance destroyed successfully.
Oct 26 06:37:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Attempting rescue
Oct 26 06:37:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74295) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Instance directory exists: not creating {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 06:37:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Creating image(s)
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG nova.objects.instance [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'trusted_certs' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.rescue {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.rescue" returned: 0 in 0.053s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.instance [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'migration_context' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.base [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<d6c25b84-4b35-4086-89a5-d5f2823b507a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Start _get_guest_xml network_info=[{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "vif_mac": "fa:16:3e:a1:3f:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.instance [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'resources' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.base [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<d6c25b84-4b35-4086-89a5-d5f2823b507a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.instance [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'numa_topology' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.base [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<d6c25b84-4b35-4086-89a5-d5f2823b507a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:37:16 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:37:16 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.instance [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.base [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<d6c25b84-4b35-4086-89a5-d5f2823b507a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1292363646',display_name='tempest-ServerRescueNegativeTestJSON-server-1292363646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1292363646',id=23,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsTZlJheNp8sVuhOrIqG8qdNLOjdx64RyRTKV9E6RNWLg7CAdzx3HBr741A9mhH3N1E6pyKCeBiyizgQdHyyg0KibIFZPr7FeQmHvdsblnqk/03y+0vGoXBplYR2DLKNA==',key_name='tempest-keypair-61692672',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:34:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-c6l7dwko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b0e86cf3ec049a58aee69c427717598',uuid=d6c25b84-4b35-4086-89a5-d5f2823b507a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "vif_mac": "fa:16:3e:a1:3f:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "vif_mac": "fa:16:3e:a1:3f:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3f:72,bridge_name='br-int',has_traffic_filtering=True,id=775a3f05-426c-473c-a0ce-499522370ef9,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775a3f05-42') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.instance [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'pci_devices' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.objects.base [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Object Instance<d6c25b84-4b35-4086-89a5-d5f2823b507a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:37:16 user nova-compute[74295]:   <uuid>d6c25b84-4b35-4086-89a5-d5f2823b507a</uuid>
Oct 26 06:37:16 user nova-compute[74295]:   <name>instance-00000017</name>
Oct 26 06:37:16 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:37:16 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:37:16 user nova-compute[74295]:   <metadata>
Oct 26 06:37:16 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:37:16 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:37:16 user nova-compute[74295]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1292363646</nova:name>
Oct 26 06:37:16 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:37:16</nova:creationTime>
Oct 26 06:37:16 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:37:16 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:37:16 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:37:16 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:37:16 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:37:16 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:37:16 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:37:16 user nova-compute[74295]:       <nova:owner>
Oct 26 06:37:16 user nova-compute[74295]:         <nova:user uuid="3b0e86cf3ec049a58aee69c427717598">tempest-ServerRescueNegativeTestJSON-1373728584-project-member</nova:user>
Oct 26 06:37:16 user nova-compute[74295]:         <nova:project uuid="65c33a42f4b946d28de9e355927737e8">tempest-ServerRescueNegativeTestJSON-1373728584</nova:project>
Oct 26 06:37:16 user nova-compute[74295]:       </nova:owner>
Oct 26 06:37:16 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:37:16 user nova-compute[74295]:       <nova:ports>
Oct 26 06:37:16 user nova-compute[74295]:         <nova:port uuid="775a3f05-426c-473c-a0ce-499522370ef9">
Oct 26 06:37:16 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 06:37:16 user nova-compute[74295]:         </nova:port>
Oct 26 06:37:16 user nova-compute[74295]:       </nova:ports>
Oct 26 06:37:16 user nova-compute[74295]:     </nova:instance>
Oct 26 06:37:16 user nova-compute[74295]:   </metadata>
Oct 26 06:37:16 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:37:16 user nova-compute[74295]:     <system>
Oct 26 06:37:16 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:37:16 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:37:16 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:37:16 user nova-compute[74295]:       <entry name="serial">d6c25b84-4b35-4086-89a5-d5f2823b507a</entry>
Oct 26 06:37:16 user nova-compute[74295]:       <entry name="uuid">d6c25b84-4b35-4086-89a5-d5f2823b507a</entry>
Oct 26 06:37:16 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:37:16 user nova-compute[74295]:     </system>
Oct 26 06:37:16 user nova-compute[74295]:   </sysinfo>
Oct 26 06:37:16 user nova-compute[74295]:   <os>
Oct 26 06:37:16 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:37:16 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:37:16 user nova-compute[74295]:   </os>
Oct 26 06:37:16 user nova-compute[74295]:   <features>
Oct 26 06:37:16 user nova-compute[74295]:     <acpi/>
Oct 26 06:37:16 user nova-compute[74295]:     <apic/>
Oct 26 06:37:16 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:37:16 user nova-compute[74295]:   </features>
Oct 26 06:37:16 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:37:16 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:37:16 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:37:16 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:37:16 user nova-compute[74295]:   </clock>
Oct 26 06:37:16 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:37:16 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:37:16 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:37:16 user nova-compute[74295]:   </cpu>
Oct 26 06:37:16 user nova-compute[74295]:   <devices>
Oct 26 06:37:16 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:37:16 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:37:16 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.rescue"/>
Oct 26 06:37:16 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:37:16 user nova-compute[74295]:     </disk>
Oct 26 06:37:16 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:37:16 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:37:16 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk"/>
Oct 26 06:37:16 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:37:16 user nova-compute[74295]:     </disk>
Oct 26 06:37:16 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:37:16 user nova-compute[74295]:       <mac address="fa:16:3e:a1:3f:72"/>
Oct 26 06:37:16 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:37:16 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:37:16 user nova-compute[74295]:       <target dev="tap775a3f05-42"/>
Oct 26 06:37:16 user nova-compute[74295]:     </interface>
Oct 26 06:37:16 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:37:16 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/console.log" append="off"/>
Oct 26 06:37:16 user nova-compute[74295]:     </serial>
Oct 26 06:37:16 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:37:16 user nova-compute[74295]:     <video>
Oct 26 06:37:16 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:37:16 user nova-compute[74295]:     </video>
Oct 26 06:37:16 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:37:16 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:37:16 user nova-compute[74295]:     </rng>
Oct 26 06:37:16 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:37:16 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:37:16 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:37:16 user nova-compute[74295]:     </memballoon>
Oct 26 06:37:16 user nova-compute[74295]:   </devices>
Oct 26 06:37:16 user nova-compute[74295]: </domain>
Oct 26 06:37:16 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:37:16 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Instance destroyed successfully.
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:37:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] No VIF found with MAC fa:16:3e:a1:3f:72, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-110737c7-ab55-41a9-98ea-c8b87b547cfd req-2c7ddcd8-eda8-438b-b4f0-2c31bb4dd75c service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-110737c7-ab55-41a9-98ea-c8b87b547cfd req-2c7ddcd8-eda8-438b-b4f0-2c31bb4dd75c service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-110737c7-ab55-41a9-98ea-c8b87b547cfd req-2c7ddcd8-eda8-438b-b4f0-2c31bb4dd75c service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-110737c7-ab55-41a9-98ea-c8b87b547cfd req-2c7ddcd8-eda8-438b-b4f0-2c31bb4dd75c service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-110737c7-ab55-41a9-98ea-c8b87b547cfd req-2c7ddcd8-eda8-438b-b4f0-2c31bb4dd75c service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:37:17 user nova-compute[74295]: WARNING nova.compute.manager [req-110737c7-ab55-41a9-98ea-c8b87b547cfd req-2c7ddcd8-eda8-438b-b4f0-2c31bb4dd75c service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state active and task_state rescuing.
Oct 26 06:37:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:17 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:37:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:37:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:37:18 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:37:18 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updating instance_info_cache with network_info: [{"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:37:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:37:18 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:37:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:37:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:37:19 user nova-compute[74295]: WARNING nova.compute.manager [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state active and task_state rescuing.
Oct 26 06:37:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:37:19 user nova-compute[74295]: WARNING nova.compute.manager [req-343dce2c-eb80-4c5c-9ec2-7b260d0a508c req-a6482d26-0101-4324-9ad9-68a1a7d404df service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state active and task_state rescuing.
Oct 26 06:37:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-641b8b31-45dd-4ed1-9dbe-b2f4e1e4d323 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:37:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:30 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d is timed out.
Oct 26 06:37:30 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully detached device vdb from instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d from the live domain config.
Oct 26 06:37:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbGnmozd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:37:30 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf446dc-7197-4b72-bc06-fbd059be3639]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:37:30 user nova-compute[74295]: No targets found.
Oct 26 06:37:30 user nova-compute[74295]: iSNS:
Oct 26 06:37:30 user nova-compute[74295]: No targets found.
Oct 26 06:37:30 user nova-compute[74295]: STATIC:
Oct 26 06:37:30 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc
Oct 26 06:37:30 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:30 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:30 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9
Oct 26 06:37:30 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:30 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:30 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813
Oct 26 06:37:30 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:30 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:30 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685
Oct 26 06:37:30 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:30 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:30 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f
Oct 26 06:37:30 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:30 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:30 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:37:30 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:30 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:30 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda
Oct 26 06:37:30 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:30 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:30 user nova-compute[74295]: FIRMWARE:
Oct 26 06:37:30 user nova-compute[74295]: No targets found.
Oct 26 06:37:30 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:37:30 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:37:30 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2571a6-1fc3-4457-8260-1bbbda4923e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c90978-366d-4017-ac86-d99fe71c2c8e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:37:30 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:30 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:37:30 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1eeef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a49bfc8-a5bc-4a3b-8c2d-e928725a0656]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[009d4c91-c3d4-4e61-aa2a-f4d72766f9ca]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:37:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eaeccf-2444-49f4-a6d7-03905cd48607]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f793a0-d776-4638-9a33-ceecc5012f6f]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a9952-413b-4c39-824e-c9a11dc67b8f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[717bada9-0b94-40d5-a4f0-f9df8d98a74e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9, portal: 172.16.0.220,3260]
Oct 26 06:37:31 user nova-compute[74295]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9, portal: 172.16.0.220,3260] successful.
Oct 26 06:37:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc733cb5-132f-4e4d-8276-6c468866b1d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[21358926-d96f-4c27-b80d-78ead4dfc115]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] <== disconnect_volume: return (313ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:37:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:37:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:37:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "6b441689-7c38-455d-a55e-6cd9615049cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:38 user nova-compute[74295]: INFO nova.compute.manager [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Terminating instance
Oct 26 06:37:38 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-0c0f30b1-8a2f-4c91-a619-1c5d769c6ee2 req-a8e18459-206f-4943-9cfa-28e9fb2f3ea9 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-unplugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0c0f30b1-8a2f-4c91-a619-1c5d769c6ee2 req-a8e18459-206f-4943-9cfa-28e9fb2f3ea9 service nova] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0c0f30b1-8a2f-4c91-a619-1c5d769c6ee2 req-a8e18459-206f-4943-9cfa-28e9fb2f3ea9 service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0c0f30b1-8a2f-4c91-a619-1c5d769c6ee2 req-a8e18459-206f-4943-9cfa-28e9fb2f3ea9 service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-0c0f30b1-8a2f-4c91-a619-1c5d769c6ee2 req-a8e18459-206f-4943-9cfa-28e9fb2f3ea9 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] No waiting events found dispatching network-vif-unplugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:37:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-0c0f30b1-8a2f-4c91-a619-1c5d769c6ee2 req-a8e18459-206f-4943-9cfa-28e9fb2f3ea9 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-unplugged-16d2b3ee-0200-4890-918e-3caddf53dcaa for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:37:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Instance destroyed successfully.
Oct 26 06:37:39 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lazy-loading 'resources' on Instance uuid 6b441689-7c38-455d-a55e-6cd9615049cf {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-967869669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1953981053',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW+yK605nx9fsnK9sPq0DGNEhK8lBG6yyAJakl9nS8lcsLe1dpyuMk9N+CMReZkLMBKhi5isWdyprLJbwq8wWYSZ9E2mQUuQM8J+Nd843KWCgj43KxseMsp4FEzwwenUw==',key_name='tempest-keypair-986045003',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51ec6997c8d74b10901d0d1edca094c8',ramdisk_id='',reservation_id='r-n0bmm11a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1864822632',owner_user_name='tempest-ServerActionsV293TestJSON-1864822632-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='463ace29d09f4b9d9460901159b82aca',uuid=6b441689-7c38-455d-a55e-6cd9615049cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converting VIF {"id": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "address": "fa:16:3e:12:22:a2", "network": {"id": "a120d91f-8cd2-48aa-ad28-3036eb762dd2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1521752495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ec6997c8d74b10901d0d1edca094c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d2b3ee-02", "ovs_interfaceid": "16d2b3ee-0200-4890-918e-3caddf53dcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_vif [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16d2b3ee-02, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ebee170-d869-436c-86b5-03ab98d302ea) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:37:39 user nova-compute[74295]: INFO os_vif [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:22:a2,bridge_name='br-int',has_traffic_filtering=True,id=16d2b3ee-0200-4890-918e-3caddf53dcaa,network=Network(a120d91f-8cd2-48aa-ad28-3036eb762dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d2b3ee-02')
Oct 26 06:37:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtyxVqzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:37:39 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[406534d6-0cfc-45ca-b112-5507b05205e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:37:39 user nova-compute[74295]: No targets found.
Oct 26 06:37:39 user nova-compute[74295]: iSNS:
Oct 26 06:37:39 user nova-compute[74295]: No targets found.
Oct 26 06:37:39 user nova-compute[74295]: STATIC:
Oct 26 06:37:39 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc
Oct 26 06:37:39 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:39 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:39 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813
Oct 26 06:37:39 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:39 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:39 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685
Oct 26 06:37:39 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:39 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:39 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f
Oct 26 06:37:39 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:39 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:39 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:37:39 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:39 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:39 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda
Oct 26 06:37:39 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:37:39 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:37:39 user nova-compute[74295]: FIRMWARE:
Oct 26 06:37:39 user nova-compute[74295]: No targets found.
Oct 26 06:37:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:37:39 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:37:39 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8720490f-e725-4ec7-aff7-93afcbd38b84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5733828-de54-4a98-a8b8-30262959b890]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:37:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:37:39 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:37:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3588527400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[753a2d07-33dd-4239-80ad-78e410dae131]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[640e315e-86f4-46dc-8c76-f6690391cc87]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bda25f-0abd-42d8-bfe5-b30e5c595838]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c988319-367a-4980-83db-0ad914714bf3]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b44d49-c446-4d18-b4d6-eb0f35285b1d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe531cf4-1cc9-4805-afc4-9296c0dc3840]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260]
Oct 26 06:37:39 user nova-compute[74295]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f, portal: 172.16.0.220,3260] successful.
Oct 26 06:37:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f879a984-b889-46ee-9eeb-db8d85769e7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d377c88e-2a55-4c77-aede-7e8d82a2f65f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] <== disconnect_volume: return (380ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:37:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Deleting instance files /opt/stack/data/nova/instances/6b441689-7c38-455d-a55e-6cd9615049cf_del
Oct 26 06:37:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Deletion of /opt/stack/data/nova/instances/6b441689-7c38-455d-a55e-6cd9615049cf_del complete
Oct 26 06:37:39 user nova-compute[74295]: INFO nova.compute.manager [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 26 06:37:39 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:37:39 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:37:40 user nova-compute[74295]: DEBUG nova.objects.instance [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'flavor' on Instance uuid d98449c4-fbe5-44cc-82d4-d5d88b28c68d {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:37:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0d6ba71f-455a-4706-a408-a7ba0ef080e7 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.064s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:40 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:37:40 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Took 0.91 seconds to deallocate network for instance.
Oct 26 06:37:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-54dcdc84-3737-4e9d-b1b0-e9e9ca929513 req-7759ecbe-efbe-4400-ab42-7b81ef01ef48 service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-deleted-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-173b9fb8-9aa5-4b60-81f8-b1898f45639d req-0f060030-1e15-4186-a90d-b6a432fd1f8b service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-173b9fb8-9aa5-4b60-81f8-b1898f45639d req-0f060030-1e15-4186-a90d-b6a432fd1f8b service nova] Acquiring lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-173b9fb8-9aa5-4b60-81f8-b1898f45639d req-0f060030-1e15-4186-a90d-b6a432fd1f8b service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-173b9fb8-9aa5-4b60-81f8-b1898f45639d req-0f060030-1e15-4186-a90d-b6a432fd1f8b service nova] Lock "6b441689-7c38-455d-a55e-6cd9615049cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-173b9fb8-9aa5-4b60-81f8-b1898f45639d req-0f060030-1e15-4186-a90d-b6a432fd1f8b service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] No waiting events found dispatching network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:37:41 user nova-compute[74295]: WARNING nova.compute.manager [req-173b9fb8-9aa5-4b60-81f8-b1898f45639d req-0f060030-1e15-4186-a90d-b6a432fd1f8b service nova] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Received unexpected event network-vif-plugged-16d2b3ee-0200-4890-918e-3caddf53dcaa for instance with vm_state active and task_state deleting.
Oct 26 06:37:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:37:43 user nova-compute[74295]: INFO nova.compute.claims [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Claim successful on node user
Oct 26 06:37:43 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 06:37:43 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 06:37:44 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:37:44 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:37:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.754s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:37:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:37:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:37:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:37:44 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:37:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:37:44 user nova-compute[74295]: DEBUG nova.policy [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '969b88effa7b4c14a9fdca34760804e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac89a741e94482bf18b56aca6a53c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:37:44 user nova-compute[74295]: INFO nova.virt.block_device [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Booting with volume-backed-image f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120 at /dev/vda
Oct 26 06:37:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Successfully created port: 67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:37:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Successfully updated port: 67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:37:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:37:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquired lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:37:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:37:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-04e9af27-21d8-4db4-9faf-49fa6be15914 req-ef7e9a8b-124b-463b-bbd1-3cd9f1a02872 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-changed-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:37:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-04e9af27-21d8-4db4-9faf-49fa6be15914 req-ef7e9a8b-124b-463b-bbd1-3cd9f1a02872 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Refreshing instance network info cache due to event network-changed-67ebefae-3edf-4872-85a7-afa6222db4df. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:37:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-04e9af27-21d8-4db4-9faf-49fa6be15914 req-ef7e9a8b-124b-463b-bbd1-3cd9f1a02872 service nova] Acquiring lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:37:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:37:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Updating instance_info_cache with network_info: [{"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:37:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Releasing lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:37:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Instance network_info: |[{"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:37:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-04e9af27-21d8-4db4-9faf-49fa6be15914 req-ef7e9a8b-124b-463b-bbd1-3cd9f1a02872 service nova] Acquired lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:37:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-04e9af27-21d8-4db4-9faf-49fa6be15914 req-ef7e9a8b-124b-463b-bbd1-3cd9f1a02872 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Refreshing network info cache for port 67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:37:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-04e9af27-21d8-4db4-9faf-49fa6be15914 req-ef7e9a8b-124b-463b-bbd1-3cd9f1a02872 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Updated VIF entry in instance network info cache for port 67ebefae-3edf-4872-85a7-afa6222db4df. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:37:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-04e9af27-21d8-4db4-9faf-49fa6be15914 req-ef7e9a8b-124b-463b-bbd1-3cd9f1a02872 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Updating instance_info_cache with network_info: [{"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:37:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-04e9af27-21d8-4db4-9faf-49fa6be15914 req-ef7e9a8b-124b-463b-bbd1-3cd9f1a02872 service nova] Releasing lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:37:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:37:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:00 user nova-compute[74295]: INFO nova.compute.manager [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Terminating instance
Oct 26 06:38:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-4fb1cdae-b67d-424f-9aa0-185732fd1520 req-232e31c4-7378-42f7-ab56-25a2455a4c07 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received event network-vif-unplugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4fb1cdae-b67d-424f-9aa0-185732fd1520 req-232e31c4-7378-42f7-ab56-25a2455a4c07 service nova] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4fb1cdae-b67d-424f-9aa0-185732fd1520 req-232e31c4-7378-42f7-ab56-25a2455a4c07 service nova] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4fb1cdae-b67d-424f-9aa0-185732fd1520 req-232e31c4-7378-42f7-ab56-25a2455a4c07 service nova] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-4fb1cdae-b67d-424f-9aa0-185732fd1520 req-232e31c4-7378-42f7-ab56-25a2455a4c07 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] No waiting events found dispatching network-vif-unplugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-4fb1cdae-b67d-424f-9aa0-185732fd1520 req-232e31c4-7378-42f7-ab56-25a2455a4c07 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received event network-vif-unplugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:38:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Instance destroyed successfully.
Oct 26 06:38:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'resources' on Instance uuid d98449c4-fbe5-44cc-82d4-d5d88b28c68d {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:32:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-793137887',display_name='tempest-AttachVolumeNegativeTest-server-793137887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-793137887',id=18,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoXQDNNys5WRJuSAj6LTcfyRa23W36vRNeTN5L6+z3ea7EplgAeFyPLh8c6LjjzeEDVMHFByhonCmIFQscAgZrSq3V9ECTgJGyjTX49C4erl7zLdxDfLBFnTGkjLKGM2Q==',key_name='tempest-keypair-1122912892',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:32:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-ybar3ss4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=d98449c4-fbe5-44cc-82d4-d5d88b28c68d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "address": "fa:16:3e:74:13:45", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9f250c3-be", "ovs_interfaceid": "c9f250c3-be94-4dd5-bee9-8c5b55470cf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:13:45,bridge_name='br-int',has_traffic_filtering=True,id=c9f250c3-be94-4dd5-bee9-8c5b55470cf8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9f250c3-be') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG os_vif [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:13:45,bridge_name='br-int',has_traffic_filtering=True,id=c9f250c3-be94-4dd5-bee9-8c5b55470cf8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9f250c3-be') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9f250c3-be, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d09bd144-17b9-4721-b134-029e61f848e2) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:01 user nova-compute[74295]: INFO os_vif [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:13:45,bridge_name='br-int',has_traffic_filtering=True,id=c9f250c3-be94-4dd5-bee9-8c5b55470cf8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9f250c3-be')
Oct 26 06:38:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Deleting instance files /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d_del
Oct 26 06:38:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Deletion of /opt/stack/data/nova/instances/d98449c4-fbe5-44cc-82d4-d5d88b28c68d_del complete
Oct 26 06:38:01 user nova-compute[74295]: INFO nova.compute.manager [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 26 06:38:01 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:38:01 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:38:01 user nova-compute[74295]: INFO nova.compute.manager [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Took 21.21 seconds to detach 1 volumes for instance.
Oct 26 06:38:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] [instance: 6b441689-7c38-455d-a55e-6cd9615049cf] Deleting volume: f879a984-b889-46ee-9eeb-db8d85769e7f {{(pid=74295) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:02 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Deleted allocations for instance 6b441689-7c38-455d-a55e-6cd9615049cf
Oct 26 06:38:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2a7c2721-ec49-41f7-99b9-ad93a3f55e8c tempest-ServerActionsV293TestJSON-1864822632 tempest-ServerActionsV293TestJSON-1864822632-project-member] Lock "6b441689-7c38-455d-a55e-6cd9615049cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 24.477s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-6285680d-5182-4feb-b002-85852d789b13 req-f5602aed-e432-41d3-94a0-a1ddab00834e service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received event network-vif-plugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6285680d-5182-4feb-b002-85852d789b13 req-f5602aed-e432-41d3-94a0-a1ddab00834e service nova] Acquiring lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6285680d-5182-4feb-b002-85852d789b13 req-f5602aed-e432-41d3-94a0-a1ddab00834e service nova] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6285680d-5182-4feb-b002-85852d789b13 req-f5602aed-e432-41d3-94a0-a1ddab00834e service nova] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-6285680d-5182-4feb-b002-85852d789b13 req-f5602aed-e432-41d3-94a0-a1ddab00834e service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] No waiting events found dispatching network-vif-plugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:02 user nova-compute[74295]: WARNING nova.compute.manager [req-6285680d-5182-4feb-b002-85852d789b13 req-f5602aed-e432-41d3-94a0-a1ddab00834e service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received unexpected event network-vif-plugged-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 for instance with vm_state active and task_state deleting.
Oct 26 06:38:03 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:03 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Took 1.82 seconds to deallocate network for instance.
Oct 26 06:38:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:03 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:38:03 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:38:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:03 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Deleted allocations for instance d98449c4-fbe5-44cc-82d4-d5d88b28c68d
Oct 26 06:38:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f7fcdc71-2f7a-4068-b0da-8ec6877cc1eb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "d98449c4-fbe5-44cc-82d4-d5d88b28c68d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.420s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-2f653bf8-6543-41da-b343-e120551c4caa req-5ae249f5-0a29-4a4e-aa1b-85c79b914b37 service nova] [instance: d98449c4-fbe5-44cc-82d4-d5d88b28c68d] Received event network-vif-deleted-c9f250c3-be94-4dd5-bee9-8c5b55470cf8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG os_brick.utils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8fadf8-d366-47e4-92c5-51e1175d5d4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad933f05-781c-49c9-b72b-78726b494627]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e89fd6-1bf2-4145-a9aa-046079377b78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e14cb6f-6666-4b28-86af-c438209ea732]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:38:05 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c3e1d7-3935-4abf-91d7-07b98bc4a12b]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG os_brick.utils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Updating existing volume attachment record: 16b3acec-02a3-49a5-b4f1-6c53215a019a {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-4b4efbf3-9f6f-4766-9c73-a77cec3674ff req-aa76b18d-2479-48f5-b0a9-3930962767bf service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-changed-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-4b4efbf3-9f6f-4766-9c73-a77cec3674ff req-aa76b18d-2479-48f5-b0a9-3930962767bf service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Refreshing instance network info cache due to event network-changed-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4b4efbf3-9f6f-4766-9c73-a77cec3674ff req-aa76b18d-2479-48f5-b0a9-3930962767bf service nova] Acquiring lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4b4efbf3-9f6f-4766-9c73-a77cec3674ff req-aa76b18d-2479-48f5-b0a9-3930962767bf service nova] Acquired lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-4b4efbf3-9f6f-4766-9c73-a77cec3674ff req-aa76b18d-2479-48f5-b0a9-3930962767bf service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Refreshing network info cache for port d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG nova.network.neutron [req-4b4efbf3-9f6f-4766-9c73-a77cec3674ff req-aa76b18d-2479-48f5-b0a9-3930962767bf service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Updated VIF entry in instance network info cache for port d745ae1a-25c3-4f4e-bfaa-4462ae430dc9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG nova.network.neutron [req-4b4efbf3-9f6f-4766-9c73-a77cec3674ff req-aa76b18d-2479-48f5-b0a9-3930962767bf service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Updating instance_info_cache with network_info: [{"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4b4efbf3-9f6f-4766-9c73-a77cec3674ff req-aa76b18d-2479-48f5-b0a9-3930962767bf service nova] Releasing lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG nova.objects.instance [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'flavor' on Instance uuid fb03897e-7f9e-497a-b703-ca862b11672f {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:06 user nova-compute[74295]: INFO nova.compute.manager [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Attaching volume e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd to /dev/vdb
Oct 26 06:38:06 user nova-compute[74295]: DEBUG os_brick.utils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be3077-9379-4282-be7c-2cfbb8d166b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b157d4a-d5b3-48bf-83ee-68bbfaa104c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4d6833-dfc2-4f91-9458-867413051032]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3352c898-d09e-4626-8cbb-b29522ed7313]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:38:06 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:38:06 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac287b6e-5fd0-4159-bbc3-d0943f6a0ce9]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG os_brick.utils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:06 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Updating existing volume attachment record: c7bc7753-d9fd-4115-a513-da56344d14e8 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:38:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:07 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:08 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:38:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:09 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:38:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:11 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:38:12 user nova-compute[74295]: INFO nova.compute.claims [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Claim successful on node user
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:38:13 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:38:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG nova.policy [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3c3d6fa25d143bc935e7e16275aac57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b6035868e347c4b90651f3ad73237a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:13 user nova-compute[74295]: INFO nova.virt.block_device [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Booting with volume 6e085787-63b6-4668-a1fe-1f4ef8729af3 at /dev/vda
Oct 26 06:38:13 user nova-compute[74295]: DEBUG os_brick.utils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee7da0a-e971-42d8-a0aa-655a315da3bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ddedf-0868-4e16-be48-e56eb9d8ac63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a0d5f-59cb-4d07-92fc-fc53b7931278]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a31cd0-caa1-41e0-ab58-86a90bd029ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:38:13 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd82182-41f8-4ad1-9fb3-8ed69e01a47f]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG os_brick.utils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating existing volume attachment record: 5eb9fce5-1ccc-4e2e-ae52-343c7ece5b1d {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Successfully created port: bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:38:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7519MB free_disk=25.236557006835938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 0440536c-c9ad-439e-aa26-689b945c63ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d6c25b84-4b35-4086-89a5-d5f2823b507a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 5610d9b7-e38f-450b-b395-480c4131f1be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fb03897e-7f9e-497a-b703-ca862b11672f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fe7578f8-07ed-4701-9292-9e1d10c5766c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:38:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Successfully updated port: bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquired lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-3a3a9496-e9be-4972-b56f-8d79d32b0b7f req-ee04efd3-d5e9-4df0-9a0b-9e487bd2a3c8 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-changed-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-3a3a9496-e9be-4972-b56f-8d79d32b0b7f req-ee04efd3-d5e9-4df0-9a0b-9e487bd2a3c8 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Refreshing instance network info cache due to event network-changed-bc714b43-0ed1-4b49-b1f8-a5eddbf64206. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3a3a9496-e9be-4972-b56f-8d79d32b0b7f req-ee04efd3-d5e9-4df0-9a0b-9e487bd2a3c8 service nova] Acquiring lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating instance_info_cache with network_info: [{"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Releasing lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Instance network_info: |[{"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3a3a9496-e9be-4972-b56f-8d79d32b0b7f req-ee04efd3-d5e9-4df0-9a0b-9e487bd2a3c8 service nova] Acquired lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-3a3a9496-e9be-4972-b56f-8d79d32b0b7f req-ee04efd3-d5e9-4df0-9a0b-9e487bd2a3c8 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Refreshing network info cache for port bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:38:16 user nova-compute[74295]: DEBUG nova.network.neutron [req-3a3a9496-e9be-4972-b56f-8d79d32b0b7f req-ee04efd3-d5e9-4df0-9a0b-9e487bd2a3c8 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updated VIF entry in instance network info cache for port bc714b43-0ed1-4b49-b1f8-a5eddbf64206. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:38:16 user nova-compute[74295]: DEBUG nova.network.neutron [req-3a3a9496-e9be-4972-b56f-8d79d32b0b7f req-ee04efd3-d5e9-4df0-9a0b-9e487bd2a3c8 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating instance_info_cache with network_info: [{"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3a3a9496-e9be-4972-b56f-8d79d32b0b7f req-ee04efd3-d5e9-4df0-9a0b-9e487bd2a3c8 service nova] Releasing lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updating instance_info_cache with network_info: [{"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:38:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:19 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:38:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-115f7a0b-049a-4d3c-a16c-3e773fd284bd req-0c88f1fd-ecfe-4643-a9ee-c46b48a5d729 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-changed-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-115f7a0b-049a-4d3c-a16c-3e773fd284bd req-0c88f1fd-ecfe-4643-a9ee-c46b48a5d729 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing instance network info cache due to event network-changed-867fc971-1a1f-4258-9543-778eff345dce. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:38:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-115f7a0b-049a-4d3c-a16c-3e773fd284bd req-0c88f1fd-ecfe-4643-a9ee-c46b48a5d729 service nova] Acquiring lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-115f7a0b-049a-4d3c-a16c-3e773fd284bd req-0c88f1fd-ecfe-4643-a9ee-c46b48a5d729 service nova] Acquired lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:25 user nova-compute[74295]: DEBUG nova.network.neutron [req-115f7a0b-049a-4d3c-a16c-3e773fd284bd req-0c88f1fd-ecfe-4643-a9ee-c46b48a5d729 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Refreshing network info cache for port 867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:38:25 user nova-compute[74295]: DEBUG nova.network.neutron [req-115f7a0b-049a-4d3c-a16c-3e773fd284bd req-0c88f1fd-ecfe-4643-a9ee-c46b48a5d729 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updated VIF entry in instance network info cache for port 867fc971-1a1f-4258-9543-778eff345dce. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:38:25 user nova-compute[74295]: DEBUG nova.network.neutron [req-115f7a0b-049a-4d3c-a16c-3e773fd284bd req-0c88f1fd-ecfe-4643-a9ee-c46b48a5d729 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [{"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-115f7a0b-049a-4d3c-a16c-3e773fd284bd req-0c88f1fd-ecfe-4643-a9ee-c46b48a5d729 service nova] Releasing lock "refresh_cache-5610d9b7-e38f-450b-b395-480c4131f1be" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:38:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Creating image(s)
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Ensure instance console log exists: /opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Start _get_guest_xml network_info=[{"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '16b3acec-02a3-49a5-b4f1-6c53215a019a', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvHscawf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c38de5f0-842d-4c0d-aa3d-208096993ccd', 'serial': 'c38de5f0-842d-4c0d-aa3d-208096993ccd'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:38:27 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:27 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvHscawf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:27 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:27 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:27 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61455bd-539c-4530-97f1-a706bb8531b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:38:27 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[095a56c8-c8e6-4454-b300-fc1ecc90d4df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd] added
Oct 26 06:38:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[57beda09-c08f-447e-9ebd-772ce9415ae4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[658732ec-fb84-49b8-8f28-f81ee5332ce6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvHscawf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvHscawf" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7cd1fc-003d-4ad2-86c6-38c916575947]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xvHscawf'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c16ba9a-c49f-4cf2-9fee-9531545bbf39]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b3460d-3da9-4150-a7d4-7a6fe1c5816c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e08698-f61b-4ca8-bd1b-d51acf866ce4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd, portal: 172.16.0.220,3260]
Oct 26 06:38:27 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd, portal: 172.16.0.220,3260] successful.
Oct 26 06:38:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae8cd5d-3c94-4024-a248-98a2564394ae]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ff5ee1-1906-46be-ad41-df1c1a0c289a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:27 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[542c37c6-12a9-406a-b6d2-8eb11dc8f6ae]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvHscawf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrWOgjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:27 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "5610d9b7-e38f-450b-b395-480c4131f1be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:28 user nova-compute[74295]: INFO nova.compute.manager [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Terminating instance
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-b3942b7d-117f-446a-bf30-140099162408 req-deac31bb-abb2-4c80-b2b0-719f99240c2e service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b3942b7d-117f-446a-bf30-140099162408 req-deac31bb-abb2-4c80-b2b0-719f99240c2e service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b3942b7d-117f-446a-bf30-140099162408 req-deac31bb-abb2-4c80-b2b0-719f99240c2e service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b3942b7d-117f-446a-bf30-140099162408 req-deac31bb-abb2-4c80-b2b0-719f99240c2e service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-b3942b7d-117f-446a-bf30-140099162408 req-deac31bb-abb2-4c80-b2b0-719f99240c2e service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-unplugged-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-b3942b7d-117f-446a-bf30-140099162408 req-deac31bb-abb2-4c80-b2b0-719f99240c2e service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-867fc971-1a1f-4258-9543-778eff345dce for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-e716f53c-e542-40a6-8b99-7bc7df088910 req-0bc28b4f-a6ff-4365-9d98-c490a104120a service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e716f53c-e542-40a6-8b99-7bc7df088910 req-0bc28b4f-a6ff-4365-9d98-c490a104120a service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e716f53c-e542-40a6-8b99-7bc7df088910 req-0bc28b4f-a6ff-4365-9d98-c490a104120a service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e716f53c-e542-40a6-8b99-7bc7df088910 req-0bc28b4f-a6ff-4365-9d98-c490a104120a service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-e716f53c-e542-40a6-8b99-7bc7df088910 req-0bc28b4f-a6ff-4365-9d98-c490a104120a service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-unplugged-077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-e716f53c-e542-40a6-8b99-7bc7df088910 req-0bc28b4f-a6ff-4365-9d98-c490a104120a service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-077906d1-ce86-449d-ad27-548e2ceaef33 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23763303839616532', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763303839616532', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.924s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:28 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:28 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f9f14-34de-4668-857e-3ab386b54ff7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:38:28 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-90833333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-90833333',id=26,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-9hmvlt98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:37:44Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:af:21,bridge_name='br-int',has_traffic_filtering=True,id=67ebefae-3edf-4872-85a7-afa6222db4df,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ebefae-3e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.objects.instance [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'pci_devices' on Instance uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f9b578-5a27-4cc2-94e5-436a1d8c07e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd] added
Oct 26 06:38:28 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:38:28 user nova-compute[74295]:   <uuid>29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7</uuid>
Oct 26 06:38:28 user nova-compute[74295]:   <name>instance-0000001a</name>
Oct 26 06:38:28 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:38:28 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:38:28 user nova-compute[74295]:   <metadata>
Oct 26 06:38:28 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:38:28 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:38:28 user nova-compute[74295]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-90833333</nova:name>
Oct 26 06:38:28 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:38:27</nova:creationTime>
Oct 26 06:38:28 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:38:28 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:38:28 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:38:28 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:38:28 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:38:28 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:38:28 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:38:28 user nova-compute[74295]:       <nova:owner>
Oct 26 06:38:28 user nova-compute[74295]:         <nova:user uuid="969b88effa7b4c14a9fdca34760804e8">tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member</nova:user>
Oct 26 06:38:28 user nova-compute[74295]:         <nova:project uuid="e0ac89a741e94482bf18b56aca6a53c1">tempest-ServerBootFromVolumeStableRescueTest-1259261992</nova:project>
Oct 26 06:38:28 user nova-compute[74295]:       </nova:owner>
Oct 26 06:38:28 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:38:28 user nova-compute[74295]:       <nova:ports>
Oct 26 06:38:28 user nova-compute[74295]:         <nova:port uuid="67ebefae-3edf-4872-85a7-afa6222db4df">
Oct 26 06:38:28 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 06:38:28 user nova-compute[74295]:         </nova:port>
Oct 26 06:38:28 user nova-compute[74295]:       </nova:ports>
Oct 26 06:38:28 user nova-compute[74295]:     </nova:instance>
Oct 26 06:38:28 user nova-compute[74295]:   </metadata>
Oct 26 06:38:28 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:38:28 user nova-compute[74295]:     <system>
Oct 26 06:38:28 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:38:28 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:38:28 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:38:28 user nova-compute[74295]:       <entry name="serial">29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7</entry>
Oct 26 06:38:28 user nova-compute[74295]:       <entry name="uuid">29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7</entry>
Oct 26 06:38:28 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:38:28 user nova-compute[74295]:     </system>
Oct 26 06:38:28 user nova-compute[74295]:   </sysinfo>
Oct 26 06:38:28 user nova-compute[74295]:   <os>
Oct 26 06:38:28 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:38:28 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:38:28 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:38:28 user nova-compute[74295]:   </os>
Oct 26 06:38:28 user nova-compute[74295]:   <features>
Oct 26 06:38:28 user nova-compute[74295]:     <acpi/>
Oct 26 06:38:28 user nova-compute[74295]:     <apic/>
Oct 26 06:38:28 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:38:28 user nova-compute[74295]:   </features>
Oct 26 06:38:28 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:38:28 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:38:28 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:38:28 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:38:28 user nova-compute[74295]:   </clock>
Oct 26 06:38:28 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:38:28 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:38:28 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:38:28 user nova-compute[74295]:   </cpu>
Oct 26 06:38:28 user nova-compute[74295]:   <devices>
Oct 26 06:38:28 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:38:28 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:38:28 user nova-compute[74295]:       <source dev="/dev/sdc"/>
Oct 26 06:38:28 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:38:28 user nova-compute[74295]:       <serial>c38de5f0-842d-4c0d-aa3d-208096993ccd</serial>
Oct 26 06:38:28 user nova-compute[74295]:     </disk>
Oct 26 06:38:28 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:38:28 user nova-compute[74295]:       <mac address="fa:16:3e:fd:af:21"/>
Oct 26 06:38:28 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:38:28 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:38:28 user nova-compute[74295]:       <target dev="tap67ebefae-3e"/>
Oct 26 06:38:28 user nova-compute[74295]:     </interface>
Oct 26 06:38:28 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:38:28 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/console.log" append="off"/>
Oct 26 06:38:28 user nova-compute[74295]:     </serial>
Oct 26 06:38:28 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:38:28 user nova-compute[74295]:     <video>
Oct 26 06:38:28 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:38:28 user nova-compute[74295]:     </video>
Oct 26 06:38:28 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:38:28 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:38:28 user nova-compute[74295]:     </rng>
Oct 26 06:38:28 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:38:28 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:38:28 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:38:28 user nova-compute[74295]:     </memballoon>
Oct 26 06:38:28 user nova-compute[74295]:   </devices>
Oct 26 06:38:28 user nova-compute[74295]: </domain>
Oct 26 06:38:28 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-90833333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-90833333',id=26,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-9hmvlt98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:37:44Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:af:21,bridge_name='br-int',has_traffic_filtering=True,id=67ebefae-3edf-4872-85a7-afa6222db4df,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ebefae-3e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_vif [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:af:21,bridge_name='br-int',has_traffic_filtering=True,id=67ebefae-3edf-4872-85a7-afa6222db4df,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ebefae-3e') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c19dd462-46f6-5d08-9b70-688c1e871877', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6eb0d-373e-4b52-a575-16adc66fd823]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c48facc-a7b1-4f93-872b-880470637bed req-cdd3187f-dfa7-4d06-802b-1fc0ab4239db service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c48facc-a7b1-4f93-872b-880470637bed req-cdd3187f-dfa7-4d06-802b-1fc0ab4239db service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c48facc-a7b1-4f93-872b-880470637bed req-cdd3187f-dfa7-4d06-802b-1fc0ab4239db service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c48facc-a7b1-4f93-872b-880470637bed req-cdd3187f-dfa7-4d06-802b-1fc0ab4239db service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c48facc-a7b1-4f93-872b-880470637bed req-cdd3187f-dfa7-4d06-802b-1fc0ab4239db service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-unplugged-09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c48facc-a7b1-4f93-872b-880470637bed req-cdd3187f-dfa7-4d06-802b-1fc0ab4239db service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-09ec26d6-fc41-4da7-8daf-820236267ba0 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b28d0a5-5c6f-4485-beea-688a56927d04]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtrWOgjn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtrWOgjn" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd4f78f-d011-4935-99c1-722a6cd74805]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtrWOgjn'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3359de9a-c6df-4a44-8845-77547351c301]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eebc30-d4f1-48ec-a3e3-21631490ed3a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67ebefae-3e, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67ebefae-3e, col_values=(('qos', UUID('fd2bbb2c-41c4-4c6f-96b4-8750e1cb68e6')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67ebefae-3e, col_values=(('external_ids', {'iface-id': '67ebefae-3edf-4872-85a7-afa6222db4df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:af:21', 'vm-uuid': '29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c541dce-fa06-47df-88bf-4a59360fe039]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd, portal: 172.16.0.220,3260]
Oct 26 06:38:29 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd, portal: 172.16.0.220,3260] successful.
Oct 26 06:38:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2df8d1-8b21-4476-9cee-5d0172e9e9b0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd68444c-3d1a-46a2-b99f-abc15866596d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:29 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.498s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.072s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a56a3ab-bf42-4cef-b19d-8bcaef5c02c0]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrWOgjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:29 user nova-compute[74295]: INFO os_vif [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:af:21,bridge_name='br-int',has_traffic_filtering=True,id=67ebefae-3edf-4872-85a7-afa6222db4df,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ebefae-3e')
Oct 26 06:38:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No VIF found with MAC fa:16:3e:fd:af:21, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Instance destroyed successfully.
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.objects.instance [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lazy-loading 'resources' on Instance uuid 5610d9b7-e38f-450b-b395-480c4131f1be {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.597s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] <== connect_volume: return (2521ms) {'type': 'block', 'scsi_wwn': '23065306365383938', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065306365383938', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:0f:18,bridge_name='br-int',has_traffic_filtering=True,id=867fc971-1a1f-4258-9543-778eff345dce,network=Network(43f08c11-48d8-4e2a-8859-00969fd21c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867fc971-1a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:0f:18,bridge_name='br-int',has_traffic_filtering=True,id=867fc971-1a1f-4258-9543-778eff345dce,network=Network(43f08c11-48d8-4e2a-8859-00969fd21c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867fc971-1a') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap867fc971-1a, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.objects.instance [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'flavor' on Instance uuid fb03897e-7f9e-497a-b703-ca862b11672f {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:38:30 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:38:30 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:38:30 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:38:30 user nova-compute[74295]:   <serial>e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd</serial>
Oct 26 06:38:30 user nova-compute[74295]: </disk>
Oct 26 06:38:30 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:30 user nova-compute[74295]: WARNING nova.compute.manager [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-867fc971-1a1f-4258-9543-778eff345dce for instance with vm_state active and task_state deleting.
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-unplugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:30 user nova-compute[74295]: WARNING nova.compute.manager [req-12cadb6e-f75b-4a66-a051-7cd7fbf0908d req-2836a65f-5755-4303-8dea-78fb6911d58f service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-8fd6e395-c8d0-4185-a2a7-a3c251931b91 for instance with vm_state active and task_state deleting.
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7f9a74b-5a87-4060-9bc1-3f07e4d694ba) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: INFO os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:0f:18,bridge_name='br-int',has_traffic_filtering=True,id=867fc971-1a1f-4258-9543-778eff345dce,network=Network(43f08c11-48d8-4e2a-8859-00969fd21c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867fc971-1a')
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=077906d1-ce86-449d-ad27-548e2ceaef33,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap077906d1-ce') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=077906d1-ce86-449d-ad27-548e2ceaef33,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap077906d1-ce') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap077906d1-ce, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-077906d1-ce86-449d-ad27-548e2ceaef33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:30 user nova-compute[74295]: WARNING nova.compute.manager [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-077906d1-ce86-449d-ad27-548e2ceaef33 for instance with vm_state active and task_state deleting.
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-unplugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:30 user nova-compute[74295]: WARNING nova.compute.manager [req-66fba03b-1b16-4bca-84bf-43caad00b3d1 req-d3919c14-dbfa-4efe-ad2c-4806e62c2892 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-ecbe87b8-c45d-48d1-8d89-5413dcf9928c for instance with vm_state active and task_state deleting.
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3bc7d0d2-7884-4c1a-80ec-1270fc7c8ecf) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: INFO os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:d2,bridge_name='br-int',has_traffic_filtering=True,id=077906d1-ce86-449d-ad27-548e2ceaef33,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap077906d1-ce')
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:10:f4,bridge_name='br-int',has_traffic_filtering=True,id=09ec26d6-fc41-4da7-8daf-820236267ba0,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09ec26d6-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:10:f4,bridge_name='br-int',has_traffic_filtering=True,id=09ec26d6-fc41-4da7-8daf-820236267ba0,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09ec26d6-fc') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09ec26d6-fc, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41b7027b-5a3f-4a0e-b412-dde0461c4c57) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: INFO os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:10:f4,bridge_name='br-int',has_traffic_filtering=True,id=09ec26d6-fc41-4da7-8daf-820236267ba0,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09ec26d6-fc')
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=72120d2f-c11b-4a8a-82a1-4c1af2c58e05,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72120d2f-c1') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=72120d2f-c11b-4a8a-82a1-4c1af2c58e05,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72120d2f-c1') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72120d2f-c1, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4eec4a18-18e5-474d-b11d-c717633165ab) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-09ec26d6-fc41-4da7-8daf-820236267ba0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:31 user nova-compute[74295]: WARNING nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-09ec26d6-fc41-4da7-8daf-820236267ba0 for instance with vm_state active and task_state deleting.
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-unplugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:31 user nova-compute[74295]: WARNING nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 for instance with vm_state active and task_state deleting.
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-unplugged-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-unplugged-427ee207-003c-4b88-9dbe-aef3d8c6fade for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-plugged-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Acquiring lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] Lock "5610d9b7-e38f-450b-b395-480c4131f1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] No waiting events found dispatching network-vif-plugged-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:31 user nova-compute[74295]: WARNING nova.compute.manager [req-4941b3e4-9825-42a1-8185-86ed188dc0c6 req-adc5bb40-83c9-43e5-bb0e-b978221ac0de service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received unexpected event network-vif-plugged-427ee207-003c-4b88-9dbe-aef3d8c6fade for instance with vm_state active and task_state deleting.
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: INFO os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=72120d2f-c11b-4a8a-82a1-4c1af2c58e05,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72120d2f-c1')
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:bd,bridge_name='br-int',has_traffic_filtering=True,id=427ee207-003c-4b88-9dbe-aef3d8c6fade,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ee207-00') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:bd,bridge_name='br-int',has_traffic_filtering=True,id=427ee207-003c-4b88-9dbe-aef3d8c6fade,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ee207-00') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap427ee207-00, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7daf9eb6-f2ec-44df-bde2-848d56633043) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: INFO os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:bd,bridge_name='br-int',has_traffic_filtering=True,id=427ee207-003c-4b88-9dbe-aef3d8c6fade,network=Network(34deb81e-7363-43e1-bcd8-31d8df5af0c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ee207-00')
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "address": "fa:16:3e:26:95:e1", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd6e395-c8", "ovs_interfaceid": "8fd6e395-c8d0-4185-a2a7-a3c251931b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:95:e1,bridge_name='br-int',has_traffic_filtering=True,id=8fd6e395-c8d0-4185-a2a7-a3c251931b91,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd6e395-c8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:95:e1,bridge_name='br-int',has_traffic_filtering=True,id=8fd6e395-c8d0-4185-a2a7-a3c251931b91,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd6e395-c8') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fd6e395-c8, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7fad9c0-9a18-4e45-886e-34e17e94651a) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: INFO os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:95:e1,bridge_name='br-int',has_traffic_filtering=True,id=8fd6e395-c8d0-4185-a2a7-a3c251931b91,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd6e395-c8')
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T06:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1280211941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1280211941',id=24,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvEC3eRvnFtajvN8kxqRtPiJ9rDlCbQVW01yrNvAdHbJgBceWOgqQVdu/hZv3XhWTg2dYMj6gY6RTdpYFdNQIAzbC5u1eUkT2dp78las+b9MqY2ahvpA9btBAnaKtu8bg==',key_name='tempest-keypair-909025227',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44b106eb404d4fb7a1f869d6228ff48c',ramdisk_id='',reservation_id='r-nszkqmc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1275084168',owner_user_name='tempest-TaggedBootDevicesTest-1275084168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c43eade49dbf406587ea5ecd09ed131f',uuid=5610d9b7-e38f-450b-b395-480c4131f1be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converting VIF {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:2f:36,bridge_name='br-int',has_traffic_filtering=True,id=ecbe87b8-c45d-48d1-8d89-5413dcf9928c,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe87b8-c4') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:2f:36,bridge_name='br-int',has_traffic_filtering=True,id=ecbe87b8-c45d-48d1-8d89-5413dcf9928c,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe87b8-c4') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecbe87b8-c4, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d91efc17-1357-456c-8cfe-3e9f80e6fcfe) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: INFO os_vif [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:2f:36,bridge_name='br-int',has_traffic_filtering=True,id=ecbe87b8-c45d-48d1-8d89-5413dcf9928c,network=Network(4a8ea66d-0708-41fc-a681-20caded29a5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe87b8-c4')
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxRsyph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:31 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca102cc6-793f-463c-9ac5-32eaf5cfcdbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:38:31 user nova-compute[74295]: No targets found.
Oct 26 06:38:31 user nova-compute[74295]: iSNS:
Oct 26 06:38:31 user nova-compute[74295]: No targets found.
Oct 26 06:38:31 user nova-compute[74295]: STATIC:
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: FIRMWARE:
Oct 26 06:38:31 user nova-compute[74295]: No targets found.
Oct 26 06:38:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:38:31 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:38:31 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83db1a6-799a-44fc-90f8-2937e380dd1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[531e29e2-1656-422e-9f84-5c3fa52371b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f358855f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda'): ({'sde'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Removing single pathed devices sde {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e39a80-0696-43bf-8775-6785fdc34a37]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No VIF found with MAC fa:16:3e:6f:31:20, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[340971b6-0bcb-4679-a021-5e725bde76de]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Flushing IO for device /dev/sde {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e26f5b5-ab6b-4c4e-8fd8-ee7633fd2faa]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16f8a2f-de78-41cd-85f9-17ff0335738e]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[df488f34-6c6e-49e4-b535-c6cc56b188ca]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-53743db1-0ff5-4afd-a7e5-73b9ee332569 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.143s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ce64d3-06fd-488b-8f6c-f0f9045ecd8c]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda, portal: 172.16.0.220,3260]
Oct 26 06:38:31 user nova-compute[74295]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda, portal: 172.16.0.220,3260] successful.
Oct 26 06:38:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d0f33c-55a7-4dfc-86d0-4c99085b9bda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a480b26-4de4-461a-9fd9-83eb6cda7910]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] <== disconnect_volume: return (459ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpmGwZbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:31 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[573781f6-d7bf-4fc7-b44c-026d733124d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:38:31 user nova-compute[74295]: No targets found.
Oct 26 06:38:31 user nova-compute[74295]: iSNS:
Oct 26 06:38:31 user nova-compute[74295]: No targets found.
Oct 26 06:38:31 user nova-compute[74295]: STATIC:
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd
Oct 26 06:38:31 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:31 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:31 user nova-compute[74295]: FIRMWARE:
Oct 26 06:38:31 user nova-compute[74295]: No targets found.
Oct 26 06:38:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:38:31 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:38:31 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[de498faa-4657-46c1-921d-1239e533062c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3021f0fb-67e9-4f44-a710-bf45aa74afef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:31 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:31 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac730700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813'): ({'sdf'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:38:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Removing single pathed devices sdf {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d9243d-93b0-410a-975a-6a82fa966799]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48e135e-35f6-40a3-940d-aae52c7efadc]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Flushing IO for device /dev/sdf {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa58727-0d50-4b4b-9147-136cf7a25ae1]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf7d951-86a5-49ae-a3e6-d6c59dc999d2]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eabbf5-7ca3-4291-9462-750c2bd2410d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fe5755-f372-4cd5-b6b1-9a5b5d5b8508]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813, portal: 172.16.0.220,3260]
Oct 26 06:38:32 user nova-compute[74295]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813, portal: 172.16.0.220,3260] successful.
Oct 26 06:38:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c9b2dd4-894f-4b15-a2c0-3c6e36466813 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e183eef-c62e-4082-b946-427bbc8a58b9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] <== disconnect_volume: return (413ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGpEidMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:32 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d223b715-6447-451a-a5ef-ab293384e745]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:38:32 user nova-compute[74295]: No targets found.
Oct 26 06:38:32 user nova-compute[74295]: iSNS:
Oct 26 06:38:32 user nova-compute[74295]: No targets found.
Oct 26 06:38:32 user nova-compute[74295]: STATIC:
Oct 26 06:38:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc
Oct 26 06:38:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:38:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685
Oct 26 06:38:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:38:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd
Oct 26 06:38:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:32 user nova-compute[74295]: FIRMWARE:
Oct 26 06:38:32 user nova-compute[74295]: No targets found.
Oct 26 06:38:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:38:32 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:38:32 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf86634-cb2f-4644-b33a-bd0cd8ce1d32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f92aab-78cb-47d1-a959-d326794cc28d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:32 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:32 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:32 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:32 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:32 user nova-compute[74295]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 (non-flash)
Oct 26 06:38:32 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:32 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:32 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac730700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685'): ({'sdg'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Removing single pathed devices sdg {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14a392f-8579-4fe7-9c22-542919477bd3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e05c713-cdbb-44a5-8be9-10560fe33cea]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Flushing IO for device /dev/sdg {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0529a068-fcf3-44bd-87b5-2e9d499ed976]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:32 user nova-compute[74295]: WARNING nova.compute.manager [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state building and task_state spawning.
Oct 26 06:38:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:32 user nova-compute[74295]: WARNING nova.compute.manager [req-9e27393b-56e9-4979-b441-5ace024d1363 req-415e7589-2f88-4d84-96b1-eb667a694a85 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state building and task_state spawning.
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab5b56a-d91b-4f0b-88d9-600156b7a6c5]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] SCSI volumes sdg have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[172135c9-e6f3-49f5-b6c1-b7084edf777a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5117d-d18a-4b87-af2f-91beccfd39bb]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685, portal: 172.16.0.220,3260]
Oct 26 06:38:32 user nova-compute[74295]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685, portal: 172.16.0.220,3260] successful.
Oct 26 06:38:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df1d4713-afc3-4af5-914a-4f0fdfb8e685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd5702f-ca9f-4751-a71f-a3d26876ab8d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] <== disconnect_volume: return (378ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:38:32 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Deleting instance files /opt/stack/data/nova/instances/5610d9b7-e38f-450b-b395-480c4131f1be_del
Oct 26 06:38:32 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Deletion of /opt/stack/data/nova/instances/5610d9b7-e38f-450b-b395-480c4131f1be_del complete
Oct 26 06:38:32 user nova-compute[74295]: INFO nova.compute.manager [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Took 4.74 seconds to destroy the instance on the hypervisor.
Oct 26 06:38:32 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:38:32 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:38:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:38:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:38:33 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Instance spawned successfully.
Oct 26 06:38:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:34 user nova-compute[74295]: INFO nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Took 6.85 seconds to spawn the instance on the hypervisor.
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:38:34 user nova-compute[74295]: INFO nova.compute.manager [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Took 51.01 seconds to build instance.
Oct 26 06:38:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-deeb6538-9031-4357-94f0-dfdd4cde69da tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.114s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:34 user nova-compute[74295]: INFO nova.compute.manager [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Detaching volume e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd
Oct 26 06:38:34 user nova-compute[74295]: INFO nova.virt.block_device [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Attempting to driver detach volume e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd from mountpoint /dev/vdb
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Attempting to detach device vdb from instance fb03897e-7f9e-497a-b703-ca862b11672f from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:38:34 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:38:34 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:38:34 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:38:34 user nova-compute[74295]:   <serial>e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd</serial>
Oct 26 06:38:34 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:38:34 user nova-compute[74295]: </disk>
Oct 26 06:38:34 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:38:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Successfully detached device vdb from instance fb03897e-7f9e-497a-b703-ca862b11672f from the persistent domain config.
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb03897e-7f9e-497a-b703-ca862b11672f from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:38:34 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:38:34 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:38:34 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:38:34 user nova-compute[74295]:   <serial>e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd</serial>
Oct 26 06:38:34 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:38:34 user nova-compute[74295]: </disk>
Oct 26 06:38:34 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:38:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb03897e-7f9e-497a-b703-ca862b11672f {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:38:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-4102f0dd-e803-423f-9b95-3b783b2dfa98 req-75ed6b8e-ef26-4305-bce4-397ef992b806 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-deleted-8fd6e395-c8d0-4185-a2a7-a3c251931b91 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:35 user nova-compute[74295]: INFO nova.compute.manager [req-4102f0dd-e803-423f-9b95-3b783b2dfa98 req-75ed6b8e-ef26-4305-bce4-397ef992b806 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Neutron deleted interface 8fd6e395-c8d0-4185-a2a7-a3c251931b91; detaching it from the instance and deleting it from the info cache
Oct 26 06:38:35 user nova-compute[74295]: DEBUG nova.network.neutron [req-4102f0dd-e803-423f-9b95-3b783b2dfa98 req-75ed6b8e-ef26-4305-bce4-397ef992b806 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [{"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "address": "fa:16:3e:fa:e6:ec", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72120d2f-c1", "ovs_interfaceid": "72120d2f-c11b-4a8a-82a1-4c1af2c58e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-4102f0dd-e803-423f-9b95-3b783b2dfa98 req-75ed6b8e-ef26-4305-bce4-397ef992b806 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Detach interface failed, port_id=8fd6e395-c8d0-4185-a2a7-a3c251931b91, reason: Instance 5610d9b7-e38f-450b-b395-480c4131f1be could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:38:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-deleted-72120d2f-c11b-4a8a-82a1-4c1af2c58e05 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:37 user nova-compute[74295]: INFO nova.compute.manager [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Neutron deleted interface 72120d2f-c11b-4a8a-82a1-4c1af2c58e05; detaching it from the instance and deleting it from the info cache
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.network.neutron [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [{"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "address": "fa:16:3e:33:2f:36", "network": {"id": "4a8ea66d-0708-41fc-a681-20caded29a5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1826276999", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe87b8-c4", "ovs_interfaceid": "ecbe87b8-c45d-48d1-8d89-5413dcf9928c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Detach interface failed, port_id=72120d2f-c11b-4a8a-82a1-4c1af2c58e05, reason: Instance 5610d9b7-e38f-450b-b395-480c4131f1be could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-deleted-ecbe87b8-c45d-48d1-8d89-5413dcf9928c {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:37 user nova-compute[74295]: INFO nova.compute.manager [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Neutron deleted interface ecbe87b8-c45d-48d1-8d89-5413dcf9928c; detaching it from the instance and deleting it from the info cache
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.network.neutron [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [{"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "address": "fa:16:3e:7a:97:bd", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ee207-00", "ovs_interfaceid": "427ee207-003c-4b88-9dbe-aef3d8c6fade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Detach interface failed, port_id=ecbe87b8-c45d-48d1-8d89-5413dcf9928c, reason: Instance 5610d9b7-e38f-450b-b395-480c4131f1be could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-deleted-427ee207-003c-4b88-9dbe-aef3d8c6fade {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:37 user nova-compute[74295]: INFO nova.compute.manager [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Neutron deleted interface 427ee207-003c-4b88-9dbe-aef3d8c6fade; detaching it from the instance and deleting it from the info cache
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.network.neutron [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [{"id": "867fc971-1a1f-4258-9543-778eff345dce", "address": "fa:16:3e:ce:0f:18", "network": {"id": "43f08c11-48d8-4e2a-8859-00969fd21c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-842393388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867fc971-1a", "ovs_interfaceid": "867fc971-1a1f-4258-9543-778eff345dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "077906d1-ce86-449d-ad27-548e2ceaef33", "address": "fa:16:3e:29:1d:d2", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077906d1-ce", "ovs_interfaceid": "077906d1-ce86-449d-ad27-548e2ceaef33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09ec26d6-fc41-4da7-8daf-820236267ba0", "address": "fa:16:3e:62:10:f4", "network": {"id": "34deb81e-7363-43e1-bcd8-31d8df5af0c0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1850010695", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44b106eb404d4fb7a1f869d6228ff48c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09ec26d6-fc", "ovs_interfaceid": "09ec26d6-fc41-4da7-8daf-820236267ba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-2121478d-38bf-47a0-9b87-d9851ead6998 req-9ed1e35a-2770-4e1a-adc9-954d64948644 service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Detach interface failed, port_id=427ee207-003c-4b88-9dbe-aef3d8c6fade, reason: Instance 5610d9b7-e38f-450b-b395-480c4131f1be could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:38:37 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:37 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Took 4.98 seconds to deallocate network for instance.
Oct 26 06:38:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-c7de112b-1ac8-46f4-9bc3-7233ce0fc7b3 req-afd2c1ac-7b03-45ee-9cfe-ea48bfc75a8c service nova] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Received event network-vif-deleted-867fc971-1a1f-4258-9543-778eff345dce {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:38:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Creating image(s)
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Ensure instance console log exists: /opt/stack/data/nova/instances/fe7578f8-07ed-4701-9292-9e1d10c5766c/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Start _get_guest_xml network_info=[{"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '5eb9fce5-1ccc-4e2e-ae52-343c7ece5b1d', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oABNVibs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fe7578f8-07ed-4701-9292-9e1d10c5766c', 'attached_at': '', 'detached_at': '', 'volume_id': '6e085787-63b6-4668-a1fe-1f4ef8729af3', 'serial': '6e085787-63b6-4668-a1fe-1f4ef8729af3'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:38:40 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:40 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oABNVibs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:40 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:40 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:40 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efdec54-c680-4446-b0da-de0cc03a118e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:38:40 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bea7bed-ba28-4b1c-a572-4f2707853747]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3] added
Oct 26 06:38:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb966710-1205-478d-b3e2-cf1408d82384]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f427ee-e07e-445d-9f57-e8c9b3bbc195]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oABNVibs {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oABNVibs" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a95862-74cd-42ef-b975-bb845a89f9ca]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oABNVibs'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c7b332-9cc2-4d78-bdba-624ebf518dda]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d1d986-3c05-4160-939e-a20f69824f6d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d526b6c1-81a1-45e7-8860-e2292c9725d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260]
Oct 26 06:38:40 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260] successful.
Oct 26 06:38:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec37b9eb-35bb-428f-94f2-22720f80b2d3]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aac3185-2144-4c60-849e-a2b955bf36b5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:38:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:40 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:38:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c057e5-9012-4af2-8afc-1d467ba6cc98]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:40 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oABNVibs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23532353137616563', 'path': '/dev/sde'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532353137616563', 'path': '/dev/sde'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-805152837',display_name='tempest-ServerActionsTestOtherA-server-805152837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-805152837',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEalUstBq4vFH7qnNchfBeKikF9/lcUlFw9j5QYSoSoqdNDpcgRH/nIAEmyjwdsmFPjVTLPazAWFfDhK1wvnJyZTilappqjUYF52/w6x/BiOg104d9g3zNtJX38DMWLdw==',key_name='tempest-keypair-977042820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-vy2gwlqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=fe7578f8-07ed-4701-9292-9e1d10c5766c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'pci_devices' on Instance uuid fe7578f8-07ed-4701-9292-9e1d10c5766c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:38:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:38:41 user nova-compute[74295]:   <uuid>fe7578f8-07ed-4701-9292-9e1d10c5766c</uuid>
Oct 26 06:38:41 user nova-compute[74295]:   <name>instance-0000001b</name>
Oct 26 06:38:41 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:38:41 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:38:41 user nova-compute[74295]:   <metadata>
Oct 26 06:38:41 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:38:41 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:38:41 user nova-compute[74295]:       <nova:name>tempest-ServerActionsTestOtherA-server-805152837</nova:name>
Oct 26 06:38:41 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:38:40</nova:creationTime>
Oct 26 06:38:41 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:38:41 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:38:41 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:38:41 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:38:41 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:38:41 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:38:41 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:38:41 user nova-compute[74295]:       <nova:owner>
Oct 26 06:38:41 user nova-compute[74295]:         <nova:user uuid="e3c3d6fa25d143bc935e7e16275aac57">tempest-ServerActionsTestOtherA-911482981-project-member</nova:user>
Oct 26 06:38:41 user nova-compute[74295]:         <nova:project uuid="83b6035868e347c4b90651f3ad73237a">tempest-ServerActionsTestOtherA-911482981</nova:project>
Oct 26 06:38:41 user nova-compute[74295]:       </nova:owner>
Oct 26 06:38:41 user nova-compute[74295]:       <nova:ports>
Oct 26 06:38:41 user nova-compute[74295]:         <nova:port uuid="bc714b43-0ed1-4b49-b1f8-a5eddbf64206">
Oct 26 06:38:41 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 06:38:41 user nova-compute[74295]:         </nova:port>
Oct 26 06:38:41 user nova-compute[74295]:       </nova:ports>
Oct 26 06:38:41 user nova-compute[74295]:     </nova:instance>
Oct 26 06:38:41 user nova-compute[74295]:   </metadata>
Oct 26 06:38:41 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:38:41 user nova-compute[74295]:     <system>
Oct 26 06:38:41 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:38:41 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:38:41 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:38:41 user nova-compute[74295]:       <entry name="serial">fe7578f8-07ed-4701-9292-9e1d10c5766c</entry>
Oct 26 06:38:41 user nova-compute[74295]:       <entry name="uuid">fe7578f8-07ed-4701-9292-9e1d10c5766c</entry>
Oct 26 06:38:41 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:38:41 user nova-compute[74295]:     </system>
Oct 26 06:38:41 user nova-compute[74295]:   </sysinfo>
Oct 26 06:38:41 user nova-compute[74295]:   <os>
Oct 26 06:38:41 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:38:41 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:38:41 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:38:41 user nova-compute[74295]:   </os>
Oct 26 06:38:41 user nova-compute[74295]:   <features>
Oct 26 06:38:41 user nova-compute[74295]:     <acpi/>
Oct 26 06:38:41 user nova-compute[74295]:     <apic/>
Oct 26 06:38:41 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:38:41 user nova-compute[74295]:   </features>
Oct 26 06:38:41 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:38:41 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:38:41 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:38:41 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:38:41 user nova-compute[74295]:   </clock>
Oct 26 06:38:41 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:38:41 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:38:41 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:38:41 user nova-compute[74295]:   </cpu>
Oct 26 06:38:41 user nova-compute[74295]:   <devices>
Oct 26 06:38:41 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:38:41 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:38:41 user nova-compute[74295]:       <source dev="/dev/sde"/>
Oct 26 06:38:41 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:38:41 user nova-compute[74295]:       <serial>6e085787-63b6-4668-a1fe-1f4ef8729af3</serial>
Oct 26 06:38:41 user nova-compute[74295]:     </disk>
Oct 26 06:38:41 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:38:41 user nova-compute[74295]:       <mac address="fa:16:3e:af:83:c7"/>
Oct 26 06:38:41 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:38:41 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:38:41 user nova-compute[74295]:       <target dev="tapbc714b43-0e"/>
Oct 26 06:38:41 user nova-compute[74295]:     </interface>
Oct 26 06:38:41 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:38:41 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/fe7578f8-07ed-4701-9292-9e1d10c5766c/console.log" append="off"/>
Oct 26 06:38:41 user nova-compute[74295]:     </serial>
Oct 26 06:38:41 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:38:41 user nova-compute[74295]:     <video>
Oct 26 06:38:41 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:38:41 user nova-compute[74295]:     </video>
Oct 26 06:38:41 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:38:41 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:38:41 user nova-compute[74295]:     </rng>
Oct 26 06:38:41 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:38:41 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:38:41 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:38:41 user nova-compute[74295]:     </memballoon>
Oct 26 06:38:41 user nova-compute[74295]:   </devices>
Oct 26 06:38:41 user nova-compute[74295]: </domain>
Oct 26 06:38:41 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-805152837',display_name='tempest-ServerActionsTestOtherA-server-805152837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-805152837',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEalUstBq4vFH7qnNchfBeKikF9/lcUlFw9j5QYSoSoqdNDpcgRH/nIAEmyjwdsmFPjVTLPazAWFfDhK1wvnJyZTilappqjUYF52/w6x/BiOg104d9g3zNtJX38DMWLdw==',key_name='tempest-keypair-977042820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-vy2gwlqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=fe7578f8-07ed-4701-9292-9e1d10c5766c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG os_vif [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cab1200c-6995-59b1-ad27-23e98b74e181', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc714b43-0e, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc714b43-0e, col_values=(('qos', UUID('a9122f06-dddd-4564-a283-ce1aa1031d8f')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc714b43-0e, col_values=(('external_ids', {'iface-id': 'bc714b43-0ed1-4b49-b1f8-a5eddbf64206', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:83:c7', 'vm-uuid': 'fe7578f8-07ed-4701-9292-9e1d10c5766c'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:42 user nova-compute[74295]: INFO os_vif [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e')
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No VIF found with MAC fa:16:3e:af:83:c7, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:38:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-3d923938-1b39-4b61-83c8-563d1f4d6e1b req-ef9bf87e-5d67-470f-9134-75f716268926 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3d923938-1b39-4b61-83c8-563d1f4d6e1b req-ef9bf87e-5d67-470f-9134-75f716268926 service nova] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3d923938-1b39-4b61-83c8-563d1f4d6e1b req-ef9bf87e-5d67-470f-9134-75f716268926 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3d923938-1b39-4b61-83c8-563d1f4d6e1b req-ef9bf87e-5d67-470f-9134-75f716268926 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-3d923938-1b39-4b61-83c8-563d1f4d6e1b req-ef9bf87e-5d67-470f-9134-75f716268926 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] No waiting events found dispatching network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:43 user nova-compute[74295]: WARNING nova.compute.manager [req-3d923938-1b39-4b61-83c8-563d1f4d6e1b req-ef9bf87e-5d67-470f-9134-75f716268926 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received unexpected event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 for instance with vm_state building and task_state spawning.
Oct 26 06:38:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-cfcb81b1-131a-4d86-8520-cdae27c57c28 req-32ca4821-7ceb-498c-bb7d-acf3f5674c2e service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cfcb81b1-131a-4d86-8520-cdae27c57c28 req-32ca4821-7ceb-498c-bb7d-acf3f5674c2e service nova] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cfcb81b1-131a-4d86-8520-cdae27c57c28 req-32ca4821-7ceb-498c-bb7d-acf3f5674c2e service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cfcb81b1-131a-4d86-8520-cdae27c57c28 req-32ca4821-7ceb-498c-bb7d-acf3f5674c2e service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-cfcb81b1-131a-4d86-8520-cdae27c57c28 req-32ca4821-7ceb-498c-bb7d-acf3f5674c2e service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] No waiting events found dispatching network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:45 user nova-compute[74295]: WARNING nova.compute.manager [req-cfcb81b1-131a-4d86-8520-cdae27c57c28 req-32ca4821-7ceb-498c-bb7d-acf3f5674c2e service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received unexpected event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 for instance with vm_state building and task_state spawning.
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:38:45 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Instance spawned successfully.
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:46 user nova-compute[74295]: INFO nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Took 5.85 seconds to spawn the instance on the hypervisor.
Oct 26 06:38:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:38:46 user nova-compute[74295]: INFO nova.compute.manager [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Took 34.45 seconds to build instance.
Oct 26 06:38:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a99fa2c-cf52-49e3-bbe5-4efdc83c34a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.633s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:38:48 user nova-compute[74295]: INFO nova.compute.claims [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Claim successful on node user
Oct 26 06:38:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.765s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:38:48 user nova-compute[74295]: INFO nova.compute.claims [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Claim successful on node user
Oct 26 06:38:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG nova.network.neutron [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:38:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:38:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG nova.policy [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '030acfa99577474290cf4fe7e3aa7ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1200573404a43989ba88c780574ffb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:38:49 user nova-compute[74295]: INFO nova.virt.block_device [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Booting with volume 665a14b7-df76-4938-91fb-6a1e1e03a433 at /dev/vda
Oct 26 06:38:49 user nova-compute[74295]: DEBUG os_brick.utils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f859ff-0c78-4998-bcdb-471e29e5723b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33056b0-94a4-4265-a8f1-e53ec40eb532]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc65891e-1dab-4807-a176-49ac1ec8e862]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28b0a6-f479-4a5b-ae93-d4fa1caf16b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:38:49 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c47d23d-99f4-42c6-b685-6adf214dfce2]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG os_brick.utils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating existing volume attachment record: d1b05124-3d0e-47b9-a6d2-894fee670902 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.060s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:38:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:38:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Successfully created port: 4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:38:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Creating image(s)
Oct 26 06:38:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG nova.policy [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78a41a82ce944e3292053de4cfb9f770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a324e48fd4a0e805b6abeaaf4e042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.241s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.233s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk 1073741824" returned: 0 in 0.079s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.279s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Successfully updated port: 4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquired lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-f89ccc44-a70d-40d1-93de-379b80793a93 req-11a1b4c6-37dd-43dd-ad04-f48433606c72 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-f89ccc44-a70d-40d1-93de-379b80793a93 req-11a1b4c6-37dd-43dd-ad04-f48433606c72 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing instance network info cache due to event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f89ccc44-a70d-40d1-93de-379b80793a93 req-11a1b4c6-37dd-43dd-ad04-f48433606c72 service nova] Acquiring lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Successfully created port: 5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Cannot resize image /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Ensure instance console log exists: /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating instance_info_cache with network_info: [{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Releasing lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Instance network_info: |[{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f89ccc44-a70d-40d1-93de-379b80793a93 req-11a1b4c6-37dd-43dd-ad04-f48433606c72 service nova] Acquired lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-f89ccc44-a70d-40d1-93de-379b80793a93 req-11a1b4c6-37dd-43dd-ad04-f48433606c72 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Successfully updated port: 5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquired lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-bf8f0a29-5747-4085-a8fb-cd7c3bbe9ca4 req-5f0c164b-d92c-4d8a-b33d-f4cade531d15 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-changed-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-bf8f0a29-5747-4085-a8fb-cd7c3bbe9ca4 req-5f0c164b-d92c-4d8a-b33d-f4cade531d15 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Refreshing instance network info cache due to event network-changed-5bd6bb7e-c803-4e38-a749-33e26c969d0b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bf8f0a29-5747-4085-a8fb-cd7c3bbe9ca4 req-5f0c164b-d92c-4d8a-b33d-f4cade531d15 service nova] Acquiring lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-f89ccc44-a70d-40d1-93de-379b80793a93 req-11a1b4c6-37dd-43dd-ad04-f48433606c72 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updated VIF entry in instance network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-f89ccc44-a70d-40d1-93de-379b80793a93 req-11a1b4c6-37dd-43dd-ad04-f48433606c72 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating instance_info_cache with network_info: [{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f89ccc44-a70d-40d1-93de-379b80793a93 req-11a1b4c6-37dd-43dd-ad04-f48433606c72 service nova] Releasing lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:52 user nova-compute[74295]: INFO nova.compute.manager [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] [instance: 5610d9b7-e38f-450b-b395-480c4131f1be] Took 15.17 seconds to detach 3 volumes for instance.
Oct 26 06:38:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Releasing lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Instance network_info: |[{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bf8f0a29-5747-4085-a8fb-cd7c3bbe9ca4 req-5f0c164b-d92c-4d8a-b33d-f4cade531d15 service nova] Acquired lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.network.neutron [req-bf8f0a29-5747-4085-a8fb-cd7c3bbe9ca4 req-5f0c164b-d92c-4d8a-b33d-f4cade531d15 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Refreshing network info cache for port 5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Start _get_guest_xml network_info=[{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:38:53 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:53 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1392926511',display_name='tempest-ServerStableDeviceRescueTest-server-1392926511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1392926511',id=29,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCldV0yuPoQiiDXH44VGXoIgKqgvSFBi6Hv9K7jeKgrzhKDrWQR5W3znD5kBdw6Jn+iX1rsymZxq81sNyNyQoFsCfnt2hU1HDWcY+plStJw6Cx9OHXS9dITlQF2ADPEWhg==',key_name='tempest-keypair-1336098653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='667a324e48fd4a0e805b6abeaaf4e042',ramdisk_id='',reservation_id='r-118ruu2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-978011123',owner_user_name='tempest-ServerStableDeviceRescueTest-978011123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:38:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78a41a82ce944e3292053de4cfb9f770',uuid=1ec0a113-9297-4a51-90fc-83951205185e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Converting VIF {"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:71:e8,bridge_name='br-int',has_traffic_filtering=True,id=5bd6bb7e-c803-4e38-a749-33e26c969d0b,network=Network(3f2414db-1d72-4464-a566-e13dc6cc475c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd6bb7e-c8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:38:53 user nova-compute[74295]:   <uuid>1ec0a113-9297-4a51-90fc-83951205185e</uuid>
Oct 26 06:38:53 user nova-compute[74295]:   <name>instance-0000001d</name>
Oct 26 06:38:53 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:38:53 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:38:53 user nova-compute[74295]:   <metadata>
Oct 26 06:38:53 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:38:53 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:38:53 user nova-compute[74295]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1392926511</nova:name>
Oct 26 06:38:53 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:38:53</nova:creationTime>
Oct 26 06:38:53 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:38:53 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:38:53 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:38:53 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:38:53 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:38:53 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:38:53 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:38:53 user nova-compute[74295]:       <nova:owner>
Oct 26 06:38:53 user nova-compute[74295]:         <nova:user uuid="78a41a82ce944e3292053de4cfb9f770">tempest-ServerStableDeviceRescueTest-978011123-project-member</nova:user>
Oct 26 06:38:53 user nova-compute[74295]:         <nova:project uuid="667a324e48fd4a0e805b6abeaaf4e042">tempest-ServerStableDeviceRescueTest-978011123</nova:project>
Oct 26 06:38:53 user nova-compute[74295]:       </nova:owner>
Oct 26 06:38:53 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:38:53 user nova-compute[74295]:       <nova:ports>
Oct 26 06:38:53 user nova-compute[74295]:         <nova:port uuid="5bd6bb7e-c803-4e38-a749-33e26c969d0b">
Oct 26 06:38:53 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 06:38:53 user nova-compute[74295]:         </nova:port>
Oct 26 06:38:53 user nova-compute[74295]:       </nova:ports>
Oct 26 06:38:53 user nova-compute[74295]:     </nova:instance>
Oct 26 06:38:53 user nova-compute[74295]:   </metadata>
Oct 26 06:38:53 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:38:53 user nova-compute[74295]:     <system>
Oct 26 06:38:53 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:38:53 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:38:53 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:38:53 user nova-compute[74295]:       <entry name="serial">1ec0a113-9297-4a51-90fc-83951205185e</entry>
Oct 26 06:38:53 user nova-compute[74295]:       <entry name="uuid">1ec0a113-9297-4a51-90fc-83951205185e</entry>
Oct 26 06:38:53 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:38:53 user nova-compute[74295]:     </system>
Oct 26 06:38:53 user nova-compute[74295]:   </sysinfo>
Oct 26 06:38:53 user nova-compute[74295]:   <os>
Oct 26 06:38:53 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:38:53 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:38:53 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:38:53 user nova-compute[74295]:   </os>
Oct 26 06:38:53 user nova-compute[74295]:   <features>
Oct 26 06:38:53 user nova-compute[74295]:     <acpi/>
Oct 26 06:38:53 user nova-compute[74295]:     <apic/>
Oct 26 06:38:53 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:38:53 user nova-compute[74295]:   </features>
Oct 26 06:38:53 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:38:53 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:38:53 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:38:53 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:38:53 user nova-compute[74295]:   </clock>
Oct 26 06:38:53 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:38:53 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:38:53 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:38:53 user nova-compute[74295]:   </cpu>
Oct 26 06:38:53 user nova-compute[74295]:   <devices>
Oct 26 06:38:53 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:38:53 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:38:53 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk"/>
Oct 26 06:38:53 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:38:53 user nova-compute[74295]:     </disk>
Oct 26 06:38:53 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:38:53 user nova-compute[74295]:       <mac address="fa:16:3e:dd:71:e8"/>
Oct 26 06:38:53 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:38:53 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:38:53 user nova-compute[74295]:       <target dev="tap5bd6bb7e-c8"/>
Oct 26 06:38:53 user nova-compute[74295]:     </interface>
Oct 26 06:38:53 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:38:53 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/console.log" append="off"/>
Oct 26 06:38:53 user nova-compute[74295]:     </serial>
Oct 26 06:38:53 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:38:53 user nova-compute[74295]:     <video>
Oct 26 06:38:53 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:38:53 user nova-compute[74295]:     </video>
Oct 26 06:38:53 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:38:53 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:38:53 user nova-compute[74295]:     </rng>
Oct 26 06:38:53 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:38:53 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:38:53 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:38:53 user nova-compute[74295]:     </memballoon>
Oct 26 06:38:53 user nova-compute[74295]:   </devices>
Oct 26 06:38:53 user nova-compute[74295]: </domain>
Oct 26 06:38:53 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1392926511',display_name='tempest-ServerStableDeviceRescueTest-server-1392926511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1392926511',id=29,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCldV0yuPoQiiDXH44VGXoIgKqgvSFBi6Hv9K7jeKgrzhKDrWQR5W3znD5kBdw6Jn+iX1rsymZxq81sNyNyQoFsCfnt2hU1HDWcY+plStJw6Cx9OHXS9dITlQF2ADPEWhg==',key_name='tempest-keypair-1336098653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='667a324e48fd4a0e805b6abeaaf4e042',ramdisk_id='',reservation_id='r-118ruu2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-978011123',owner_user_name='tempest-ServerStableDeviceRescueTest-978011123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:38:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78a41a82ce944e3292053de4cfb9f770',uuid=1ec0a113-9297-4a51-90fc-83951205185e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Converting VIF {"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:71:e8,bridge_name='br-int',has_traffic_filtering=True,id=5bd6bb7e-c803-4e38-a749-33e26c969d0b,network=Network(3f2414db-1d72-4464-a566-e13dc6cc475c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd6bb7e-c8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG os_vif [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:71:e8,bridge_name='br-int',has_traffic_filtering=True,id=5bd6bb7e-c803-4e38-a749-33e26c969d0b,network=Network(3f2414db-1d72-4464-a566-e13dc6cc475c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd6bb7e-c8') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c38c9180-9afd-548a-970d-104f0fcd0156', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bd6bb7e-c8, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bd6bb7e-c8, col_values=(('qos', UUID('1e39aaf1-6555-4bb7-8be6-bf539b64e8b3')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bd6bb7e-c8, col_values=(('external_ids', {'iface-id': '5bd6bb7e-c803-4e38-a749-33e26c969d0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:71:e8', 'vm-uuid': '1ec0a113-9297-4a51-90fc-83951205185e'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:53 user nova-compute[74295]: INFO os_vif [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:71:e8,bridge_name='br-int',has_traffic_filtering=True,id=5bd6bb7e-c803-4e38-a749-33e26c969d0b,network=Network(3f2414db-1d72-4464-a566-e13dc6cc475c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd6bb7e-c8')
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] No VIF found with MAC fa:16:3e:dd:71:e8, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.network.neutron [req-bf8f0a29-5747-4085-a8fb-cd7c3bbe9ca4 req-5f0c164b-d92c-4d8a-b33d-f4cade531d15 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updated VIF entry in instance network info cache for port 5bd6bb7e-c803-4e38-a749-33e26c969d0b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.network.neutron [req-bf8f0a29-5747-4085-a8fb-cd7c3bbe9ca4 req-5f0c164b-d92c-4d8a-b33d-f4cade531d15 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bf8f0a29-5747-4085-a8fb-cd7c3bbe9ca4 req-5f0c164b-d92c-4d8a-b33d-f4cade531d15 service nova] Releasing lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:38:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.752s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:53 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Deleted allocations for instance 5610d9b7-e38f-450b-b395-480c4131f1be
Oct 26 06:38:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-80f6a5da-ce02-45bd-ac9e-7fb0fa2c004f tempest-TaggedBootDevicesTest-1275084168 tempest-TaggedBootDevicesTest-1275084168-project-member] Lock "5610d9b7-e38f-450b-b395-480c4131f1be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 25.948s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:55 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb03897e-7f9e-497a-b703-ca862b11672f is timed out.
Oct 26 06:38:55 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Successfully detached device vdb from instance fb03897e-7f9e-497a-b703-ca862b11672f from the live domain config.
Oct 26 06:38:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtrWOgjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:38:55 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8304cbcc-1a0d-42c5-af54-75cdd35f1f60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:38:55 user nova-compute[74295]: No targets found.
Oct 26 06:38:55 user nova-compute[74295]: iSNS:
Oct 26 06:38:55 user nova-compute[74295]: No targets found.
Oct 26 06:38:55 user nova-compute[74295]: STATIC:
Oct 26 06:38:55 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc
Oct 26 06:38:55 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:55 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:55 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3
Oct 26 06:38:55 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:55 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:55 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:38:55 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:55 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:55 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:38:55 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:55 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:55 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd
Oct 26 06:38:55 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:38:55 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:38:55 user nova-compute[74295]: FIRMWARE:
Oct 26 06:38:55 user nova-compute[74295]: No targets found.
Oct 26 06:38:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:38:55 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:38:55 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-3f3bf505-00f5-4dc3-9d46-05d3b24847f8 req-02145091-1b54-41e5-b47a-8390e3d1a19d service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3f3bf505-00f5-4dc3-9d46-05d3b24847f8 req-02145091-1b54-41e5-b47a-8390e3d1a19d service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3f3bf505-00f5-4dc3-9d46-05d3b24847f8 req-02145091-1b54-41e5-b47a-8390e3d1a19d service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3f3bf505-00f5-4dc3-9d46-05d3b24847f8 req-02145091-1b54-41e5-b47a-8390e3d1a19d service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-3f3bf505-00f5-4dc3-9d46-05d3b24847f8 req-02145091-1b54-41e5-b47a-8390e3d1a19d service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:55 user nova-compute[74295]: WARNING nova.compute.manager [req-3f3bf505-00f5-4dc3-9d46-05d3b24847f8 req-02145091-1b54-41e5-b47a-8390e3d1a19d service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state building and task_state spawning.
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b4415f-6926-45e5-b994-07378abf7f1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a186bf5f-b7e9-4249-8c5c-eb83ee0b254f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:55 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:55 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:55 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:55 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:38:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:38:55 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:38:55 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:38:55 user nova-compute[74295]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd (non-flash)
Oct 26 06:38:55 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:38:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f358879ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e422bf-7d53-4762-aa55-cd5ee0ec07f3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50986f6-9896-48b5-9a23-ea789e384854]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc56a504-ce50-4ad2-a463-45832a84e778]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd569d4-1831-4a1b-974b-7db6d0926ee7]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[690d16b1-662e-44aa-aba4-59d392a7a85d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd7876e-1357-416b-a8f6-5cfe94d2d55c]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd, portal: 172.16.0.220,3260]
Oct 26 06:38:55 user nova-compute[74295]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd, portal: 172.16.0.220,3260] successful.
Oct 26 06:38:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e56ba2-0f4d-4e00-87b9-8fcf40ddb3dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6a62c5-6c5a-4678-aaaf-5282f1735a45]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] <== disconnect_volume: return (471ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:38:56 user nova-compute[74295]: INFO nova.compute.claims [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Claim successful on node user
Oct 26 06:38:56 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'flavor' on Instance uuid fb03897e-7f9e-497a-b703-ca862b11672f {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e7edab9d-1ad6-482e-b856-e06e1c6d862d tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.428s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:38:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.policy [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a23e0e206f504aaeb7909b322ea2d563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c9296eef7f4c45b5275803942de414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:38:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Creating image(s)
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "/opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "/opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.045s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-90fce069-edc9-49f1-ad84-c4981ae745ed req-f99ca0a2-ff9a-4e49-8f67-fa2b3b171dd5 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-90fce069-edc9-49f1-ad84-c4981ae745ed req-f99ca0a2-ff9a-4e49-8f67-fa2b3b171dd5 service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-90fce069-edc9-49f1-ad84-c4981ae745ed req-f99ca0a2-ff9a-4e49-8f67-fa2b3b171dd5 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-90fce069-edc9-49f1-ad84-c4981ae745ed req-f99ca0a2-ff9a-4e49-8f67-fa2b3b171dd5 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-90fce069-edc9-49f1-ad84-c4981ae745ed req-f99ca0a2-ff9a-4e49-8f67-fa2b3b171dd5 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:38:57 user nova-compute[74295]: WARNING nova.compute.manager [req-90fce069-edc9-49f1-ad84-c4981ae745ed req-f99ca0a2-ff9a-4e49-8f67-fa2b3b171dd5 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state building and task_state spawning.
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.259s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:38:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Instance spawned successfully.
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.247s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:57 user nova-compute[74295]: INFO nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Took 7.45 seconds to spawn the instance on the hypervisor.
Oct 26 06:38:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk 1073741824" returned: 0 in 0.141s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.392s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Successfully created port: fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.219s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:58 user nova-compute[74295]: INFO nova.compute.manager [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Took 9.49 seconds to build instance.
Oct 26 06:38:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ab2-fba7-4d3e-b646-b179b6dac5d0 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.691s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Cannot resize image /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Ensure instance console log exists: /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Successfully updated port: fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "refresh_cache-f6d582e2-2c02-45b3-bac6-fb63c09c5344" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquired lock "refresh_cache-f6d582e2-2c02-45b3-bac6-fb63c09c5344" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Updating instance_info_cache with network_info: [{"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Releasing lock "refresh_cache-f6d582e2-2c02-45b3-bac6-fb63c09c5344" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Instance network_info: |[{"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Start _get_guest_xml network_info=[{"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-ce4403e1-56fb-46fe-8bc4-2f6eabffc65d req-c6eb1801-8dfb-4427-bf84-b6f60f96d9cb service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received event network-changed-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-ce4403e1-56fb-46fe-8bc4-2f6eabffc65d req-c6eb1801-8dfb-4427-bf84-b6f60f96d9cb service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Refreshing instance network info cache due to event network-changed-fe72cf72-4a62-4633-9d46-a030363c03d8. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ce4403e1-56fb-46fe-8bc4-2f6eabffc65d req-c6eb1801-8dfb-4427-bf84-b6f60f96d9cb service nova] Acquiring lock "refresh_cache-f6d582e2-2c02-45b3-bac6-fb63c09c5344" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ce4403e1-56fb-46fe-8bc4-2f6eabffc65d req-c6eb1801-8dfb-4427-bf84-b6f60f96d9cb service nova] Acquired lock "refresh_cache-f6d582e2-2c02-45b3-bac6-fb63c09c5344" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-ce4403e1-56fb-46fe-8bc4-2f6eabffc65d req-c6eb1801-8dfb-4427-bf84-b6f60f96d9cb service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Refreshing network info cache for port fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:38:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2010550983',display_name='tempest-AttachVolumeNegativeTest-server-2010550983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2010550983',id=30,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEskSwzoFqf4CJPYDTxtpxnDoXKwpEAwMd7moX6qjR9nrDBDUGx+jSmIVWbMqzCKOiStFVbgfuqeiWwGovKDRWx4lU3c7uqLJWZlBxmCy0onbKzHFUQ4KThYaO9vwtInKw==',key_name='tempest-keypair-1778652475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-ufb15qnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:38:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=f6d582e2-2c02-45b3-bac6-fb63c09c5344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3a:1f,bridge_name='br-int',has_traffic_filtering=True,id=fe72cf72-4a62-4633-9d46-a030363c03d8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe72cf72-4a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'pci_devices' on Instance uuid f6d582e2-2c02-45b3-bac6-fb63c09c5344 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:38:59 user nova-compute[74295]:   <uuid>f6d582e2-2c02-45b3-bac6-fb63c09c5344</uuid>
Oct 26 06:38:59 user nova-compute[74295]:   <name>instance-0000001e</name>
Oct 26 06:38:59 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:38:59 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:38:59 user nova-compute[74295]:   <metadata>
Oct 26 06:38:59 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:38:59 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:38:59 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2010550983</nova:name>
Oct 26 06:38:59 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:38:59</nova:creationTime>
Oct 26 06:38:59 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:38:59 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:38:59 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:38:59 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:38:59 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:38:59 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:38:59 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:38:59 user nova-compute[74295]:       <nova:owner>
Oct 26 06:38:59 user nova-compute[74295]:         <nova:user uuid="a23e0e206f504aaeb7909b322ea2d563">tempest-AttachVolumeNegativeTest-1112300090-project-member</nova:user>
Oct 26 06:38:59 user nova-compute[74295]:         <nova:project uuid="c2c9296eef7f4c45b5275803942de414">tempest-AttachVolumeNegativeTest-1112300090</nova:project>
Oct 26 06:38:59 user nova-compute[74295]:       </nova:owner>
Oct 26 06:38:59 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:38:59 user nova-compute[74295]:       <nova:ports>
Oct 26 06:38:59 user nova-compute[74295]:         <nova:port uuid="fe72cf72-4a62-4633-9d46-a030363c03d8">
Oct 26 06:38:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:38:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:38:59 user nova-compute[74295]:       </nova:ports>
Oct 26 06:38:59 user nova-compute[74295]:     </nova:instance>
Oct 26 06:38:59 user nova-compute[74295]:   </metadata>
Oct 26 06:38:59 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:38:59 user nova-compute[74295]:     <system>
Oct 26 06:38:59 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:38:59 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:38:59 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:38:59 user nova-compute[74295]:       <entry name="serial">f6d582e2-2c02-45b3-bac6-fb63c09c5344</entry>
Oct 26 06:38:59 user nova-compute[74295]:       <entry name="uuid">f6d582e2-2c02-45b3-bac6-fb63c09c5344</entry>
Oct 26 06:38:59 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:38:59 user nova-compute[74295]:     </system>
Oct 26 06:38:59 user nova-compute[74295]:   </sysinfo>
Oct 26 06:38:59 user nova-compute[74295]:   <os>
Oct 26 06:38:59 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:38:59 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:38:59 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:38:59 user nova-compute[74295]:   </os>
Oct 26 06:38:59 user nova-compute[74295]:   <features>
Oct 26 06:38:59 user nova-compute[74295]:     <acpi/>
Oct 26 06:38:59 user nova-compute[74295]:     <apic/>
Oct 26 06:38:59 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:38:59 user nova-compute[74295]:   </features>
Oct 26 06:38:59 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:38:59 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:38:59 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:38:59 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:38:59 user nova-compute[74295]:   </clock>
Oct 26 06:38:59 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:38:59 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:38:59 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:38:59 user nova-compute[74295]:   </cpu>
Oct 26 06:38:59 user nova-compute[74295]:   <devices>
Oct 26 06:38:59 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:38:59 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:38:59 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk"/>
Oct 26 06:38:59 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:38:59 user nova-compute[74295]:     </disk>
Oct 26 06:38:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:38:59 user nova-compute[74295]:       <mac address="fa:16:3e:9c:3a:1f"/>
Oct 26 06:38:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:38:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:38:59 user nova-compute[74295]:       <target dev="tapfe72cf72-4a"/>
Oct 26 06:38:59 user nova-compute[74295]:     </interface>
Oct 26 06:38:59 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:38:59 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/console.log" append="off"/>
Oct 26 06:38:59 user nova-compute[74295]:     </serial>
Oct 26 06:38:59 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:38:59 user nova-compute[74295]:     <video>
Oct 26 06:38:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:38:59 user nova-compute[74295]:     </video>
Oct 26 06:38:59 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:38:59 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:38:59 user nova-compute[74295]:     </rng>
Oct 26 06:38:59 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:38:59 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:38:59 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:38:59 user nova-compute[74295]:     </memballoon>
Oct 26 06:38:59 user nova-compute[74295]:   </devices>
Oct 26 06:38:59 user nova-compute[74295]: </domain>
Oct 26 06:38:59 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2010550983',display_name='tempest-AttachVolumeNegativeTest-server-2010550983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2010550983',id=30,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEskSwzoFqf4CJPYDTxtpxnDoXKwpEAwMd7moX6qjR9nrDBDUGx+jSmIVWbMqzCKOiStFVbgfuqeiWwGovKDRWx4lU3c7uqLJWZlBxmCy0onbKzHFUQ4KThYaO9vwtInKw==',key_name='tempest-keypair-1778652475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-ufb15qnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:38:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=f6d582e2-2c02-45b3-bac6-fb63c09c5344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3a:1f,bridge_name='br-int',has_traffic_filtering=True,id=fe72cf72-4a62-4633-9d46-a030363c03d8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe72cf72-4a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG os_vif [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3a:1f,bridge_name='br-int',has_traffic_filtering=True,id=fe72cf72-4a62-4633-9d46-a030363c03d8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe72cf72-4a') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5d117d1-04e6-5ff1-b7fe-3c15c9140d2c', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe72cf72-4a, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe72cf72-4a, col_values=(('qos', UUID('8ed158da-3d5a-4eb8-9064-0f846e815bd5')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe72cf72-4a, col_values=(('external_ids', {'iface-id': 'fe72cf72-4a62-4633-9d46-a030363c03d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:3a:1f', 'vm-uuid': 'f6d582e2-2c02-45b3-bac6-fb63c09c5344'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:38:59 user nova-compute[74295]: INFO os_vif [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3a:1f,bridge_name='br-int',has_traffic_filtering=True,id=fe72cf72-4a62-4633-9d46-a030363c03d8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe72cf72-4a')
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No VIF found with MAC fa:16:3e:9c:3a:1f, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-ce4403e1-56fb-46fe-8bc4-2f6eabffc65d req-c6eb1801-8dfb-4427-bf84-b6f60f96d9cb service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Updated VIF entry in instance network info cache for port fe72cf72-4a62-4633-9d46-a030363c03d8. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-ce4403e1-56fb-46fe-8bc4-2f6eabffc65d req-c6eb1801-8dfb-4427-bf84-b6f60f96d9cb service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Updating instance_info_cache with network_info: [{"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:38:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ce4403e1-56fb-46fe-8bc4-2f6eabffc65d req-c6eb1801-8dfb-4427-bf84-b6f60f96d9cb service nova] Releasing lock "refresh_cache-f6d582e2-2c02-45b3-bac6-fb63c09c5344" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:39:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-3765d8a4-cf3d-4eaf-b2d8-9cd45a7d46be req-dcdcb9b6-81cc-4d0b-ac7e-8bc20410b08f service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received event network-vif-plugged-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3765d8a4-cf3d-4eaf-b2d8-9cd45a7d46be req-dcdcb9b6-81cc-4d0b-ac7e-8bc20410b08f service nova] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3765d8a4-cf3d-4eaf-b2d8-9cd45a7d46be req-dcdcb9b6-81cc-4d0b-ac7e-8bc20410b08f service nova] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3765d8a4-cf3d-4eaf-b2d8-9cd45a7d46be req-dcdcb9b6-81cc-4d0b-ac7e-8bc20410b08f service nova] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-3765d8a4-cf3d-4eaf-b2d8-9cd45a7d46be req-dcdcb9b6-81cc-4d0b-ac7e-8bc20410b08f service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] No waiting events found dispatching network-vif-plugged-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:01 user nova-compute[74295]: WARNING nova.compute.manager [req-3765d8a4-cf3d-4eaf-b2d8-9cd45a7d46be req-dcdcb9b6-81cc-4d0b-ac7e-8bc20410b08f service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received unexpected event network-vif-plugged-fe72cf72-4a62-4633-9d46-a030363c03d8 for instance with vm_state building and task_state spawning.
Oct 26 06:39:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-372c47cb-c2e5-4397-8651-81658af1cacc req-24b08fc0-0cfe-4d76-9f40-26533d0ae313 service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received event network-vif-plugged-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-372c47cb-c2e5-4397-8651-81658af1cacc req-24b08fc0-0cfe-4d76-9f40-26533d0ae313 service nova] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-372c47cb-c2e5-4397-8651-81658af1cacc req-24b08fc0-0cfe-4d76-9f40-26533d0ae313 service nova] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-372c47cb-c2e5-4397-8651-81658af1cacc req-24b08fc0-0cfe-4d76-9f40-26533d0ae313 service nova] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-372c47cb-c2e5-4397-8651-81658af1cacc req-24b08fc0-0cfe-4d76-9f40-26533d0ae313 service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] No waiting events found dispatching network-vif-plugged-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:03 user nova-compute[74295]: WARNING nova.compute.manager [req-372c47cb-c2e5-4397-8651-81658af1cacc req-24b08fc0-0cfe-4d76-9f40-26533d0ae313 service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received unexpected event network-vif-plugged-fe72cf72-4a62-4633-9d46-a030363c03d8 for instance with vm_state building and task_state spawning.
Oct 26 06:39:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:39:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:39:03 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Instance spawned successfully.
Oct 26 06:39:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:39:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:04 user nova-compute[74295]: INFO nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Took 6.85 seconds to spawn the instance on the hypervisor.
Oct 26 06:39:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:39:04 user nova-compute[74295]: INFO nova.compute.manager [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Took 8.04 seconds to build instance.
Oct 26 06:39:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6a5720fa-b92c-4b63-aeb6-a87b17f22f53 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.219s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:06 user nova-compute[74295]: INFO nova.compute.manager [None req-d46b985f-00f1-47e0-b79b-de7c9abb6356 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Unrescuing
Oct 26 06:39:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d46b985f-00f1-47e0-b79b-de7c9abb6356 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:39:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d46b985f-00f1-47e0-b79b-de7c9abb6356 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquired lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:39:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-d46b985f-00f1-47e0-b79b-de7c9abb6356 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:39:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-d46b985f-00f1-47e0-b79b-de7c9abb6356 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updating instance_info_cache with network_info: [{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:39:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d46b985f-00f1-47e0-b79b-de7c9abb6356 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Releasing lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:39:06 user nova-compute[74295]: DEBUG nova.objects.instance [None req-d46b985f-00f1-47e0-b79b-de7c9abb6356 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'flavor' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:39:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-09fbba97-9634-4290-8ca5-03785c97fa88 req-7dd6f0ab-83db-4ea5-a658-dcb152506488 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-unplugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-09fbba97-9634-4290-8ca5-03785c97fa88 req-7dd6f0ab-83db-4ea5-a658-dcb152506488 service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-09fbba97-9634-4290-8ca5-03785c97fa88 req-7dd6f0ab-83db-4ea5-a658-dcb152506488 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-09fbba97-9634-4290-8ca5-03785c97fa88 req-7dd6f0ab-83db-4ea5-a658-dcb152506488 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-09fbba97-9634-4290-8ca5-03785c97fa88 req-7dd6f0ab-83db-4ea5-a658-dcb152506488 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-unplugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:07 user nova-compute[74295]: WARNING nova.compute.manager [req-09fbba97-9634-4290-8ca5-03785c97fa88 req-7dd6f0ab-83db-4ea5-a658-dcb152506488 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-unplugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:39:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:07 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:39:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Instance destroyed successfully.
Oct 26 06:39:08 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-74051623-926a-4bba-9cc1-165e87f8e6c8 req-a5ebd903-b807-4a3b-a25f-274b7fca0d80 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74051623-926a-4bba-9cc1-165e87f8e6c8 req-a5ebd903-b807-4a3b-a25f-274b7fca0d80 service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74051623-926a-4bba-9cc1-165e87f8e6c8 req-a5ebd903-b807-4a3b-a25f-274b7fca0d80 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-74051623-926a-4bba-9cc1-165e87f8e6c8 req-a5ebd903-b807-4a3b-a25f-274b7fca0d80 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-74051623-926a-4bba-9cc1-165e87f8e6c8 req-a5ebd903-b807-4a3b-a25f-274b7fca0d80 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:09 user nova-compute[74295]: WARNING nova.compute.manager [req-74051623-926a-4bba-9cc1-165e87f8e6c8 req-a5ebd903-b807-4a3b-a25f-274b7fca0d80 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:39:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:10 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:39:10 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:39:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:39:10 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:39:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:10 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:11 user nova-compute[74295]: WARNING nova.compute.manager [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:39:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:11 user nova-compute[74295]: WARNING nova.compute.manager [req-3e833d2a-366a-496e-a7bc-3929a01cd151 req-a3b8f76e-12fb-4916-8d0e-0de3fc584673 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:39:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d46b985f-00f1-47e0-b79b-de7c9abb6356 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:39:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:39:16 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:39:16 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7359MB free_disk=25.219058990478516GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 0440536c-c9ad-439e-aa26-689b945c63ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d6c25b84-4b35-4086-89a5-d5f2823b507a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fb03897e-7f9e-497a-b703-ca862b11672f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fe7578f8-07ed-4701-9292-9e1d10c5766c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c6fb7cff-07da-4441-b992-ec7fee6dd92b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1ec0a113-9297-4a51-90fc-83951205185e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:39:16 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:39:17 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:39:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.746s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-0440536c-c9ad-439e-aa26-689b945c63ea" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-0440536c-c9ad-439e-aa26-689b945c63ea" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Updating instance_info_cache with network_info: [{"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-0440536c-c9ad-439e-aa26-689b945c63ea" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:39:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:39:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:39:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:39:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Creating image(s)
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Ensure instance console log exists: /opt/stack/data/nova/instances/c6fb7cff-07da-4441-b992-ec7fee6dd92b/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Start _get_guest_xml network_info=[{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'd1b05124-3d0e-47b9-a6d2-894fee670902', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuWserJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c6fb7cff-07da-4441-b992-ec7fee6dd92b', 'attached_at': '', 'detached_at': '', 'volume_id': '665a14b7-df76-4938-91fb-6a1e1e03a433', 'serial': '665a14b7-df76-4938-91fb-6a1e1e03a433'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:39:34 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:39:34 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuWserJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:39:34 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:39:34 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:39:34 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[795b70af-f857-4474-b726-ea2fa65bb38c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:39:34 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d36bea0-972f-4aab-9821-8be102f3b623]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433] added
Oct 26 06:39:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c2bc6a-bbb4-4974-b214-830c001d0539]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0cac39-88e1-4c15-9a12-574e02ddf468]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuWserJE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuWserJE" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c65bfe-65ad-4c6e-b07f-14d145519204]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QuWserJE'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2accd1d-151d-45a5-94a2-2a29793335ea]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadee2bc-2471-45f3-b037-4342f9891bba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[29609931-7906-4571-b7d6-568a30fec663]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260]
Oct 26 06:39:34 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260] successful.
Oct 26 06:39:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f4f77d-7b81-4e8e-aa3c-fa3d7ccfc322]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd4aaa8-b1bd-478d-816d-a4ac7f02b6b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:39:34 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b789fe-b8a6-4536-b448-3e37a758d59e]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:39:34 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuWserJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26537366330343161', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537366330343161', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1080291082',display_name='tempest-TestShelveInstance-server-1080291082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1080291082',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHyyG9m2+qncT6D1l6xWi4NskP03lOdp11CJoUdl4QeqjSIivDvMBGZjdN4UqF+ClnuoDFBAyJyYZR2dkI7HjbKWL4pWkBTTPctPMX9xmRxYo8i2qIKW03GWZiibLqVLg==',key_name='tempest-TestShelveInstance-1955889839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1200573404a43989ba88c780574ffb4',ramdisk_id='',reservation_id='r-wt3jzqse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-930828987',owner_user_name='tempest-TestShelveInstance-930828987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:38:49Z,user_data=None,user_id='030acfa99577474290cf4fe7e3aa7ed2',uuid=c6fb7cff-07da-4441-b992-ec7fee6dd92b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converting VIF {"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.objects.instance [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lazy-loading 'pci_devices' on Instance uuid c6fb7cff-07da-4441-b992-ec7fee6dd92b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:39:35 user nova-compute[74295]:   <uuid>c6fb7cff-07da-4441-b992-ec7fee6dd92b</uuid>
Oct 26 06:39:35 user nova-compute[74295]:   <name>instance-0000001c</name>
Oct 26 06:39:35 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:39:35 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:39:35 user nova-compute[74295]:   <metadata>
Oct 26 06:39:35 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:39:35 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:39:35 user nova-compute[74295]:       <nova:name>tempest-TestShelveInstance-server-1080291082</nova:name>
Oct 26 06:39:35 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:39:34</nova:creationTime>
Oct 26 06:39:35 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:39:35 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:39:35 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:39:35 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:39:35 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:39:35 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:39:35 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:39:35 user nova-compute[74295]:       <nova:owner>
Oct 26 06:39:35 user nova-compute[74295]:         <nova:user uuid="030acfa99577474290cf4fe7e3aa7ed2">tempest-TestShelveInstance-930828987-project-member</nova:user>
Oct 26 06:39:35 user nova-compute[74295]:         <nova:project uuid="b1200573404a43989ba88c780574ffb4">tempest-TestShelveInstance-930828987</nova:project>
Oct 26 06:39:35 user nova-compute[74295]:       </nova:owner>
Oct 26 06:39:35 user nova-compute[74295]:       <nova:ports>
Oct 26 06:39:35 user nova-compute[74295]:         <nova:port uuid="4ecd91eb-3d2e-404b-88f0-1cb61e06732f">
Oct 26 06:39:35 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 06:39:35 user nova-compute[74295]:         </nova:port>
Oct 26 06:39:35 user nova-compute[74295]:       </nova:ports>
Oct 26 06:39:35 user nova-compute[74295]:     </nova:instance>
Oct 26 06:39:35 user nova-compute[74295]:   </metadata>
Oct 26 06:39:35 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:39:35 user nova-compute[74295]:     <system>
Oct 26 06:39:35 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:39:35 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:39:35 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:39:35 user nova-compute[74295]:       <entry name="serial">c6fb7cff-07da-4441-b992-ec7fee6dd92b</entry>
Oct 26 06:39:35 user nova-compute[74295]:       <entry name="uuid">c6fb7cff-07da-4441-b992-ec7fee6dd92b</entry>
Oct 26 06:39:35 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:39:35 user nova-compute[74295]:     </system>
Oct 26 06:39:35 user nova-compute[74295]:   </sysinfo>
Oct 26 06:39:35 user nova-compute[74295]:   <os>
Oct 26 06:39:35 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:39:35 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:39:35 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:39:35 user nova-compute[74295]:   </os>
Oct 26 06:39:35 user nova-compute[74295]:   <features>
Oct 26 06:39:35 user nova-compute[74295]:     <acpi/>
Oct 26 06:39:35 user nova-compute[74295]:     <apic/>
Oct 26 06:39:35 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:39:35 user nova-compute[74295]:   </features>
Oct 26 06:39:35 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:39:35 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:39:35 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:39:35 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:39:35 user nova-compute[74295]:   </clock>
Oct 26 06:39:35 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:39:35 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:39:35 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:39:35 user nova-compute[74295]:   </cpu>
Oct 26 06:39:35 user nova-compute[74295]:   <devices>
Oct 26 06:39:35 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:39:35 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:39:35 user nova-compute[74295]:       <source dev="/dev/sdd"/>
Oct 26 06:39:35 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:39:35 user nova-compute[74295]:       <serial>665a14b7-df76-4938-91fb-6a1e1e03a433</serial>
Oct 26 06:39:35 user nova-compute[74295]:     </disk>
Oct 26 06:39:35 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:39:35 user nova-compute[74295]:       <mac address="fa:16:3e:c9:6e:99"/>
Oct 26 06:39:35 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:39:35 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:39:35 user nova-compute[74295]:       <target dev="tap4ecd91eb-3d"/>
Oct 26 06:39:35 user nova-compute[74295]:     </interface>
Oct 26 06:39:35 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:39:35 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/c6fb7cff-07da-4441-b992-ec7fee6dd92b/console.log" append="off"/>
Oct 26 06:39:35 user nova-compute[74295]:     </serial>
Oct 26 06:39:35 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:39:35 user nova-compute[74295]:     <video>
Oct 26 06:39:35 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:39:35 user nova-compute[74295]:     </video>
Oct 26 06:39:35 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:39:35 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:39:35 user nova-compute[74295]:     </rng>
Oct 26 06:39:35 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:39:35 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:39:35 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:39:35 user nova-compute[74295]:     </memballoon>
Oct 26 06:39:35 user nova-compute[74295]:   </devices>
Oct 26 06:39:35 user nova-compute[74295]: </domain>
Oct 26 06:39:35 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1080291082',display_name='tempest-TestShelveInstance-server-1080291082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1080291082',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHyyG9m2+qncT6D1l6xWi4NskP03lOdp11CJoUdl4QeqjSIivDvMBGZjdN4UqF+ClnuoDFBAyJyYZR2dkI7HjbKWL4pWkBTTPctPMX9xmRxYo8i2qIKW03GWZiibLqVLg==',key_name='tempest-TestShelveInstance-1955889839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1200573404a43989ba88c780574ffb4',ramdisk_id='',reservation_id='r-wt3jzqse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-930828987',owner_user_name='tempest-TestShelveInstance-930828987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:38:49Z,user_data=None,user_id='030acfa99577474290cf4fe7e3aa7ed2',uuid=c6fb7cff-07da-4441-b992-ec7fee6dd92b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converting VIF {"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG os_vif [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fd4d428-2624-5a0c-864d-7c6952afdae7', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ecd91eb-3d, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ecd91eb-3d, col_values=(('qos', UUID('469219d6-b289-4f18-9996-41721c617c6c')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ecd91eb-3d, col_values=(('external_ids', {'iface-id': '4ecd91eb-3d2e-404b-88f0-1cb61e06732f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:6e:99', 'vm-uuid': 'c6fb7cff-07da-4441-b992-ec7fee6dd92b'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:35 user nova-compute[74295]: INFO os_vif [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d')
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:39:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] No VIF found with MAC fa:16:3e:c9:6e:99, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG nova.compute.manager [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-21a1e853-3eec-4a4a-9a50-f720a7566981 req-8fc0965c-ccad-4feb-9c4a-162cfcb62352 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-21a1e853-3eec-4a4a-9a50-f720a7566981 req-8fc0965c-ccad-4feb-9c4a-162cfcb62352 service nova] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-21a1e853-3eec-4a4a-9a50-f720a7566981 req-8fc0965c-ccad-4feb-9c4a-162cfcb62352 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-21a1e853-3eec-4a4a-9a50-f720a7566981 req-8fc0965c-ccad-4feb-9c4a-162cfcb62352 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG nova.compute.manager [req-21a1e853-3eec-4a4a-9a50-f720a7566981 req-8fc0965c-ccad-4feb-9c4a-162cfcb62352 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] No waiting events found dispatching network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:37 user nova-compute[74295]: WARNING nova.compute.manager [req-21a1e853-3eec-4a4a-9a50-f720a7566981 req-8fc0965c-ccad-4feb-9c4a-162cfcb62352 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received unexpected event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f for instance with vm_state building and task_state spawning.
Oct 26 06:39:37 user nova-compute[74295]: INFO nova.compute.manager [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] instance snapshotting
Oct 26 06:39:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Beginning live snapshot process
Oct 26 06:39:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json -f qcow2 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json -f qcow2 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.195s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1qcst3hc/d148096f07e242769a91e0104ec3c70a.delta 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1qcst3hc/d148096f07e242769a91e0104ec3c70a.delta 1073741824" returned: 0 in 0.056s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:38 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 06:39:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-46f5afbc-10ee-490d-880b-a79ce6df011d req-9a24af1e-2651-4983-9b84-3645e6f8e106 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-46f5afbc-10ee-490d-880b-a79ce6df011d req-9a24af1e-2651-4983-9b84-3645e6f8e106 service nova] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-46f5afbc-10ee-490d-880b-a79ce6df011d req-9a24af1e-2651-4983-9b84-3645e6f8e106 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-46f5afbc-10ee-490d-880b-a79ce6df011d req-9a24af1e-2651-4983-9b84-3645e6f8e106 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-46f5afbc-10ee-490d-880b-a79ce6df011d req-9a24af1e-2651-4983-9b84-3645e6f8e106 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] No waiting events found dispatching network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:39 user nova-compute[74295]: WARNING nova.compute.manager [req-46f5afbc-10ee-490d-880b-a79ce6df011d req-9a24af1e-2651-4983-9b84-3645e6f8e106 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received unexpected event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f for instance with vm_state building and task_state spawning.
Oct 26 06:39:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:39:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:39:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:39:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Instance spawned successfully.
Oct 26 06:39:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:40 user nova-compute[74295]: INFO nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Took 5.92 seconds to spawn the instance on the hypervisor.
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] COPY block job progress, current cursor: 20840448 final cursor: 75563008 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:39:40 user nova-compute[74295]: INFO nova.compute.manager [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Took 52.26 seconds to build instance.
Oct 26 06:39:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-50d6d161-b43c-4d40-a7d7-c9ebe392b102 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.640s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 06:39:40 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:39:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1qcst3hc/d148096f07e242769a91e0104ec3c70a.delta /opt/stack/data/nova/instances/snapshots/tmp1qcst3hc/d148096f07e242769a91e0104ec3c70a {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1qcst3hc/d148096f07e242769a91e0104ec3c70a.delta /opt/stack/data/nova/instances/snapshots/tmp1qcst3hc/d148096f07e242769a91e0104ec3c70a" returned: 0 in 0.612s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:41 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Snapshot extracted, beginning image upload
Oct 26 06:39:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:44 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Snapshot image upload complete
Oct 26 06:39:44 user nova-compute[74295]: INFO nova.compute.manager [None req-aaddf5f5-98c9-4a3d-bdda-56e953925b2a tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Took 6.91 seconds to snapshot the instance on the hypervisor.
Oct 26 06:39:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:39:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:39:47 user nova-compute[74295]: INFO nova.compute.claims [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Claim successful on node user
Oct 26 06:39:47 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:39:47 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:39:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:39:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:39:48 user nova-compute[74295]: DEBUG nova.network.neutron [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:39:48 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:39:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:39:48 user nova-compute[74295]: DEBUG nova.policy [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f6d23275c654de1926a7cb988451d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8af562736824561a4f55f68f27a0b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:39:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:39:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:39:48 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Creating image(s)
Oct 26 06:39:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "/opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "/opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "/opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "feb1bf699456465ab613bf79c2110ef3c47b0947" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "feb1bf699456465ab613bf79c2110ef3c47b0947" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:49 user nova-compute[74295]: DEBUG nova.network.neutron [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Successfully created port: 7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:39:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947.part --force-share --output=json" returned: 0 in 0.285s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:49 user nova-compute[74295]: DEBUG nova.virt.images [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] d2564feb-386e-4011-88c2-94e0d29c8c1a was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 06:39:49 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:39:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947.part /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947.part /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947.converted" returned: 0 in 0.368s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "feb1bf699456465ab613bf79c2110ef3c47b0947" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.142s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Successfully updated port: 7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquired lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-e76c41ed-bba5-4f8b-8353-9e8c161c00d3 req-1d08b67a-bc69-46a4-b1a8-27d6fed44936 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received event network-changed-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-e76c41ed-bba5-4f8b-8353-9e8c161c00d3 req-1d08b67a-bc69-46a4-b1a8-27d6fed44936 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Refreshing instance network info cache due to event network-changed-7e4de530-6d56-4e35-a1b7-cbb3746ede9d. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e76c41ed-bba5-4f8b-8353-9e8c161c00d3 req-1d08b67a-bc69-46a4-b1a8-27d6fed44936 service nova] Acquiring lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947 --force-share --output=json" returned: 0 in 0.240s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "feb1bf699456465ab613bf79c2110ef3c47b0947" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "feb1bf699456465ab613bf79c2110ef3c47b0947" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947 --force-share --output=json" returned: 0 in 0.238s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947,backing_fmt=raw /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947,backing_fmt=raw /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk 1073741824" returned: 0 in 0.073s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "feb1bf699456465ab613bf79c2110ef3c47b0947" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Updating instance_info_cache with network_info: [{"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Releasing lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Instance network_info: |[{"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e76c41ed-bba5-4f8b-8353-9e8c161c00d3 req-1d08b67a-bc69-46a4-b1a8-27d6fed44936 service nova] Acquired lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.network.neutron [req-e76c41ed-bba5-4f8b-8353-9e8c161c00d3 req-1d08b67a-bc69-46a4-b1a8-27d6fed44936 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Refreshing network info cache for port 7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947 --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Ensure instance console log exists: /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Start _get_guest_xml network_info=[{"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='fad3605e90793348a44c3bd7d508d1bf',container_format='bare',created_at=2023-10-26T06:39:37Z,direct_url=<?>,disk_format='qcow2',id=d2564feb-386e-4011-88c2-94e0d29c8c1a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-684990378',owner='d8af562736824561a4f55f68f27a0b85',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T06:39:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'd2564feb-386e-4011-88c2-94e0d29c8c1a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:39:51 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:39:51 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fad3605e90793348a44c3bd7d508d1bf',container_format='bare',created_at=2023-10-26T06:39:37Z,direct_url=<?>,disk_format='qcow2',id=d2564feb-386e-4011-88c2-94e0d29c8c1a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-684990378',owner='d8af562736824561a4f55f68f27a0b85',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T06:39:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2083745609',display_name='tempest-TestStampPattern-server-2083745609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2083745609',id=31,image_ref='d2564feb-386e-4011-88c2-94e0d29c8c1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEAdKcn8BfIKAadtFceMe64jXIA47ijBG6BK3Cx0+eFXmVCy7VFEkebqDvzRsQ0zTl6IjK9Qm73ynWPZigB9lmyvdFYYVp4BU04c1HSaUw88rA3kLK5vGAV3HV0ee2Bw==',key_name='tempest-TestStampPattern-1605295167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8af562736824561a4f55f68f27a0b85',ramdisk_id='',reservation_id='r-m00do7f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fb03897e-7f9e-497a-b703-ca862b11672f',image_min_disk='1',image_min_ram='0',image_owner_id='d8af562736824561a4f55f68f27a0b85',image_owner_project_name='tempest-TestStampPattern-91727882',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-91727882-project-member',image_user_id='5f6d23275c654de1926a7cb988451d10',network_allocated='True',owner_project_name='tempest-TestStampPattern-91727882',owner_user_name='tempest-TestStampPattern-91727882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:39:48Z,user_data=None,user_id='5f6d23275c654de1926a7cb988451d10',uuid=02d21159-fa28-4df3-b40b-031765d424c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converting VIF {"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e4de530-6d56-4e35-a1b7-cbb3746ede9d,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4de530-6d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.objects.instance [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'pci_devices' on Instance uuid 02d21159-fa28-4df3-b40b-031765d424c2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:39:51 user nova-compute[74295]:   <uuid>02d21159-fa28-4df3-b40b-031765d424c2</uuid>
Oct 26 06:39:51 user nova-compute[74295]:   <name>instance-0000001f</name>
Oct 26 06:39:51 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:39:51 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:39:51 user nova-compute[74295]:   <metadata>
Oct 26 06:39:51 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:39:51 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:39:51 user nova-compute[74295]:       <nova:name>tempest-TestStampPattern-server-2083745609</nova:name>
Oct 26 06:39:51 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:39:51</nova:creationTime>
Oct 26 06:39:51 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:39:51 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:39:51 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:39:51 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:39:51 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:39:51 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:39:51 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:39:51 user nova-compute[74295]:       <nova:owner>
Oct 26 06:39:51 user nova-compute[74295]:         <nova:user uuid="5f6d23275c654de1926a7cb988451d10">tempest-TestStampPattern-91727882-project-member</nova:user>
Oct 26 06:39:51 user nova-compute[74295]:         <nova:project uuid="d8af562736824561a4f55f68f27a0b85">tempest-TestStampPattern-91727882</nova:project>
Oct 26 06:39:51 user nova-compute[74295]:       </nova:owner>
Oct 26 06:39:51 user nova-compute[74295]:       <nova:root type="image" uuid="d2564feb-386e-4011-88c2-94e0d29c8c1a"/>
Oct 26 06:39:51 user nova-compute[74295]:       <nova:ports>
Oct 26 06:39:51 user nova-compute[74295]:         <nova:port uuid="7e4de530-6d56-4e35-a1b7-cbb3746ede9d">
Oct 26 06:39:51 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:39:51 user nova-compute[74295]:         </nova:port>
Oct 26 06:39:51 user nova-compute[74295]:       </nova:ports>
Oct 26 06:39:51 user nova-compute[74295]:     </nova:instance>
Oct 26 06:39:51 user nova-compute[74295]:   </metadata>
Oct 26 06:39:51 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:39:51 user nova-compute[74295]:     <system>
Oct 26 06:39:51 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:39:51 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:39:51 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:39:51 user nova-compute[74295]:       <entry name="serial">02d21159-fa28-4df3-b40b-031765d424c2</entry>
Oct 26 06:39:51 user nova-compute[74295]:       <entry name="uuid">02d21159-fa28-4df3-b40b-031765d424c2</entry>
Oct 26 06:39:51 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:39:51 user nova-compute[74295]:     </system>
Oct 26 06:39:51 user nova-compute[74295]:   </sysinfo>
Oct 26 06:39:51 user nova-compute[74295]:   <os>
Oct 26 06:39:51 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:39:51 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:39:51 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:39:51 user nova-compute[74295]:   </os>
Oct 26 06:39:51 user nova-compute[74295]:   <features>
Oct 26 06:39:51 user nova-compute[74295]:     <acpi/>
Oct 26 06:39:51 user nova-compute[74295]:     <apic/>
Oct 26 06:39:51 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:39:51 user nova-compute[74295]:   </features>
Oct 26 06:39:51 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:39:51 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:39:51 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:39:51 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:39:51 user nova-compute[74295]:   </clock>
Oct 26 06:39:51 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:39:51 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:39:51 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:39:51 user nova-compute[74295]:   </cpu>
Oct 26 06:39:51 user nova-compute[74295]:   <devices>
Oct 26 06:39:51 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:39:51 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:39:51 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk"/>
Oct 26 06:39:51 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:39:51 user nova-compute[74295]:     </disk>
Oct 26 06:39:51 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:39:51 user nova-compute[74295]:       <mac address="fa:16:3e:92:4a:ba"/>
Oct 26 06:39:51 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:39:51 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:39:51 user nova-compute[74295]:       <target dev="tap7e4de530-6d"/>
Oct 26 06:39:51 user nova-compute[74295]:     </interface>
Oct 26 06:39:51 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:39:51 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/console.log" append="off"/>
Oct 26 06:39:51 user nova-compute[74295]:     </serial>
Oct 26 06:39:51 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:39:51 user nova-compute[74295]:     <video>
Oct 26 06:39:51 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:39:51 user nova-compute[74295]:     </video>
Oct 26 06:39:51 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:39:51 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:39:51 user nova-compute[74295]:     </rng>
Oct 26 06:39:51 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:39:51 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:39:51 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:39:51 user nova-compute[74295]:     </memballoon>
Oct 26 06:39:51 user nova-compute[74295]:   </devices>
Oct 26 06:39:51 user nova-compute[74295]: </domain>
Oct 26 06:39:51 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2083745609',display_name='tempest-TestStampPattern-server-2083745609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2083745609',id=31,image_ref='d2564feb-386e-4011-88c2-94e0d29c8c1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEAdKcn8BfIKAadtFceMe64jXIA47ijBG6BK3Cx0+eFXmVCy7VFEkebqDvzRsQ0zTl6IjK9Qm73ynWPZigB9lmyvdFYYVp4BU04c1HSaUw88rA3kLK5vGAV3HV0ee2Bw==',key_name='tempest-TestStampPattern-1605295167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8af562736824561a4f55f68f27a0b85',ramdisk_id='',reservation_id='r-m00do7f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fb03897e-7f9e-497a-b703-ca862b11672f',image_min_disk='1',image_min_ram='0',image_owner_id='d8af562736824561a4f55f68f27a0b85',image_owner_project_name='tempest-TestStampPattern-91727882',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-91727882-project-member',image_user_id='5f6d23275c654de1926a7cb988451d10',network_allocated='True',owner_project_name='tempest-TestStampPattern-91727882',owner_user_name='tempest-TestStampPattern-91727882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:39:48Z,user_data=None,user_id='5f6d23275c654de1926a7cb988451d10',uuid=02d21159-fa28-4df3-b40b-031765d424c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converting VIF {"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e4de530-6d56-4e35-a1b7-cbb3746ede9d,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4de530-6d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG os_vif [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e4de530-6d56-4e35-a1b7-cbb3746ede9d,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4de530-6d') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01bc9927-4994-5a66-979c-92ef92b8530f', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e4de530-6d, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e4de530-6d, col_values=(('qos', UUID('6e219cac-e866-4c24-adf9-eca4b67a8c38')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e4de530-6d, col_values=(('external_ids', {'iface-id': '7e4de530-6d56-4e35-a1b7-cbb3746ede9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:4a:ba', 'vm-uuid': '02d21159-fa28-4df3-b40b-031765d424c2'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:51 user nova-compute[74295]: INFO os_vif [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e4de530-6d56-4e35-a1b7-cbb3746ede9d,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4de530-6d')
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No VIF found with MAC fa:16:3e:92:4a:ba, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.network.neutron [req-e76c41ed-bba5-4f8b-8353-9e8c161c00d3 req-1d08b67a-bc69-46a4-b1a8-27d6fed44936 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Updated VIF entry in instance network info cache for port 7e4de530-6d56-4e35-a1b7-cbb3746ede9d. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG nova.network.neutron [req-e76c41ed-bba5-4f8b-8353-9e8c161c00d3 req-1d08b67a-bc69-46a4-b1a8-27d6fed44936 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Updating instance_info_cache with network_info: [{"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:39:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e76c41ed-bba5-4f8b-8353-9e8c161c00d3 req-1d08b67a-bc69-46a4-b1a8-27d6fed44936 service nova] Releasing lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:39:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-a9781358-490e-4ac3-b198-cae2e30047c7 req-0a18553e-4174-44e2-84e3-5ea0876f6434 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received event network-vif-plugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a9781358-490e-4ac3-b198-cae2e30047c7 req-0a18553e-4174-44e2-84e3-5ea0876f6434 service nova] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a9781358-490e-4ac3-b198-cae2e30047c7 req-0a18553e-4174-44e2-84e3-5ea0876f6434 service nova] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a9781358-490e-4ac3-b198-cae2e30047c7 req-0a18553e-4174-44e2-84e3-5ea0876f6434 service nova] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-a9781358-490e-4ac3-b198-cae2e30047c7 req-0a18553e-4174-44e2-84e3-5ea0876f6434 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] No waiting events found dispatching network-vif-plugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:53 user nova-compute[74295]: WARNING nova.compute.manager [req-a9781358-490e-4ac3-b198-cae2e30047c7 req-0a18553e-4174-44e2-84e3-5ea0876f6434 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received unexpected event network-vif-plugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d for instance with vm_state building and task_state spawning.
Oct 26 06:39:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-c9532ffd-e0e4-45b1-b7fd-b5332eeea386 req-f1a4da1e-fd7e-4964-93d7-993b37313a00 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received event network-vif-plugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:39:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c9532ffd-e0e4-45b1-b7fd-b5332eeea386 req-f1a4da1e-fd7e-4964-93d7-993b37313a00 service nova] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:39:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c9532ffd-e0e4-45b1-b7fd-b5332eeea386 req-f1a4da1e-fd7e-4964-93d7-993b37313a00 service nova] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:39:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c9532ffd-e0e4-45b1-b7fd-b5332eeea386 req-f1a4da1e-fd7e-4964-93d7-993b37313a00 service nova] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-c9532ffd-e0e4-45b1-b7fd-b5332eeea386 req-f1a4da1e-fd7e-4964-93d7-993b37313a00 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] No waiting events found dispatching network-vif-plugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:39:55 user nova-compute[74295]: WARNING nova.compute.manager [req-c9532ffd-e0e4-45b1-b7fd-b5332eeea386 req-f1a4da1e-fd7e-4964-93d7-993b37313a00 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received unexpected event network-vif-plugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d for instance with vm_state building and task_state spawning.
Oct 26 06:39:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:39:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:39:55 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Instance spawned successfully.
Oct 26 06:39:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:39:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:39:55 user nova-compute[74295]: INFO nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Took 7.09 seconds to spawn the instance on the hypervisor.
Oct 26 06:39:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:39:55 user nova-compute[74295]: INFO nova.compute.manager [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Took 8.15 seconds to build instance.
Oct 26 06:39:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-60b73366-d6df-444a-ba56-b2c153605c63 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.286s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:39:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:39:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-d05a58ae-ca91-4992-8365-506e3bd1a426 req-df57bca1-15f2-4309-a205-801b5f582765 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received event network-changed-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-d05a58ae-ca91-4992-8365-506e3bd1a426 req-df57bca1-15f2-4309-a205-801b5f582765 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Refreshing instance network info cache due to event network-changed-6f426b1f-4f0b-43d7-aea7-6a6c3e130773. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:40:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d05a58ae-ca91-4992-8365-506e3bd1a426 req-df57bca1-15f2-4309-a205-801b5f582765 service nova] Acquiring lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:40:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d05a58ae-ca91-4992-8365-506e3bd1a426 req-df57bca1-15f2-4309-a205-801b5f582765 service nova] Acquired lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:40:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-d05a58ae-ca91-4992-8365-506e3bd1a426 req-df57bca1-15f2-4309-a205-801b5f582765 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Refreshing network info cache for port 6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:40:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-d05a58ae-ca91-4992-8365-506e3bd1a426 req-df57bca1-15f2-4309-a205-801b5f582765 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updated VIF entry in instance network info cache for port 6f426b1f-4f0b-43d7-aea7-6a6c3e130773. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:40:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-d05a58ae-ca91-4992-8365-506e3bd1a426 req-df57bca1-15f2-4309-a205-801b5f582765 service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updating instance_info_cache with network_info: [{"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:40:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d05a58ae-ca91-4992-8365-506e3bd1a426 req-df57bca1-15f2-4309-a205-801b5f582765 service nova] Releasing lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:40:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-ff66fdcb-0248-4fbd-a8ee-31978c053011 req-bfd45a4e-9d77-46a0-abb7-724b3f8092f4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-changed-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-ff66fdcb-0248-4fbd-a8ee-31978c053011 req-bfd45a4e-9d77-46a0-abb7-724b3f8092f4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Refreshing instance network info cache due to event network-changed-bc714b43-0ed1-4b49-b1f8-a5eddbf64206. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:40:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ff66fdcb-0248-4fbd-a8ee-31978c053011 req-bfd45a4e-9d77-46a0-abb7-724b3f8092f4 service nova] Acquiring lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:40:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ff66fdcb-0248-4fbd-a8ee-31978c053011 req-bfd45a4e-9d77-46a0-abb7-724b3f8092f4 service nova] Acquired lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:40:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-ff66fdcb-0248-4fbd-a8ee-31978c053011 req-bfd45a4e-9d77-46a0-abb7-724b3f8092f4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Refreshing network info cache for port bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:40:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-ff66fdcb-0248-4fbd-a8ee-31978c053011 req-bfd45a4e-9d77-46a0-abb7-724b3f8092f4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updated VIF entry in instance network info cache for port bc714b43-0ed1-4b49-b1f8-a5eddbf64206. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:40:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-ff66fdcb-0248-4fbd-a8ee-31978c053011 req-bfd45a4e-9d77-46a0-abb7-724b3f8092f4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating instance_info_cache with network_info: [{"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:40:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ff66fdcb-0248-4fbd-a8ee-31978c053011 req-bfd45a4e-9d77-46a0-abb7-724b3f8092f4 service nova] Releasing lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:40:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Stashing vm_state: active {{(pid=74295) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 06:40:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:06 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:40:06 user nova-compute[74295]: INFO nova.compute.claims [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Claim successful on node user
Oct 26 06:40:06 user nova-compute[74295]: INFO nova.compute.resource_tracker [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating resource usage from migration 2b8791c8-dfc7-42a6-8bf5-b62fcff5a5d1
Oct 26 06:40:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:06 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:40:06 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:40:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.581s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:06 user nova-compute[74295]: INFO nova.compute.manager [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Migrating
Oct 26 06:40:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:40:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquired lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:40:06 user nova-compute[74295]: DEBUG nova.network.neutron [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG nova.network.neutron [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating instance_info_cache with network_info: [{"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Releasing lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Starting migrate_disk_and_power_off {{(pid=74295) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-630fb538-7fe3-420a-9a91-ff538ace51a4 req-4f690b42-d04a-4f0a-908f-5bead5515dc4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-unplugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-630fb538-7fe3-420a-9a91-ff538ace51a4 req-4f690b42-d04a-4f0a-908f-5bead5515dc4 service nova] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-630fb538-7fe3-420a-9a91-ff538ace51a4 req-4f690b42-d04a-4f0a-908f-5bead5515dc4 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-630fb538-7fe3-420a-9a91-ff538ace51a4 req-4f690b42-d04a-4f0a-908f-5bead5515dc4 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-630fb538-7fe3-420a-9a91-ff538ace51a4 req-4f690b42-d04a-4f0a-908f-5bead5515dc4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] No waiting events found dispatching network-vif-unplugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:07 user nova-compute[74295]: WARNING nova.compute.manager [req-630fb538-7fe3-420a-9a91-ff538ace51a4 req-4f690b42-d04a-4f0a-908f-5bead5515dc4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received unexpected event network-vif-unplugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 for instance with vm_state active and task_state resize_migrating.
Oct 26 06:40:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Instance destroyed successfully.
Oct 26 06:40:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-805152837',display_name='tempest-ServerActionsTestOtherA-server-805152837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-805152837',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEalUstBq4vFH7qnNchfBeKikF9/lcUlFw9j5QYSoSoqdNDpcgRH/nIAEmyjwdsmFPjVTLPazAWFfDhK1wvnJyZTilappqjUYF52/w6x/BiOg104d9g3zNtJX38DMWLdw==',key_name='tempest-keypair-977042820',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:38:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-vy2gwlqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:40:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=fe7578f8-07ed-4701-9292-9e1d10c5766c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-131214272-network", "vif_mac": "fa:16:3e:af:83:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-131214272-network", "vif_mac": "fa:16:3e:af:83:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_vif [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc714b43-0e, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9122f06-dddd-4564-a283-ce1aa1031d8f) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:40:08 user nova-compute[74295]: INFO os_vif [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e')
Oct 26 06:40:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oABNVibs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:40:08 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f7a958-3b87-450a-bf93-a61177e77c8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:40:08 user nova-compute[74295]: No targets found.
Oct 26 06:40:08 user nova-compute[74295]: iSNS:
Oct 26 06:40:08 user nova-compute[74295]: No targets found.
Oct 26 06:40:08 user nova-compute[74295]: STATIC:
Oct 26 06:40:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc
Oct 26 06:40:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:40:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:40:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3
Oct 26 06:40:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:40:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:40:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:40:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:40:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:40:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433
Oct 26 06:40:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:40:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:40:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:40:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:40:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:40:08 user nova-compute[74295]: FIRMWARE:
Oct 26 06:40:08 user nova-compute[74295]: No targets found.
Oct 26 06:40:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:40:08 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:40:08 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d437aa56-8bbc-4433-8799-53003952ea59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[73160f33-87fa-424f-8ba7-98409153db66]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:40:08 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:40:08 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:40:08 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:40:08 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:40:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:40:08 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:40:08 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:40:08 user nova-compute[74295]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:40:08 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:40:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3588798d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3'): ({'sde'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Removing single pathed devices sde {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[369f8ad4-c4d4-492e-a61c-32bc01e44e0f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c66fcd-a744-4d7a-b885-75cb7ca765f5]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flushing IO for device /dev/sde {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.033s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f64da27-88f8-4bb2-9e1d-2a9f246288fc]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.161s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e2db3b-34ad-4fea-9101-4b899fa43a25]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa9d04f6-52517aecd08f9ab3', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a9d04f6', '/dev/disk/by-id/scsi-23532353137616563') {{(pid=85963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 06:40:08 user nova-compute[74295]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOa9d04f6-52517aecd08f9ab3
Oct 26 06:40:08 user nova-compute[74295]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a9d04f6
Oct 26 06:40:08 user nova-compute[74295]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23532353137616563
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[472e9a27-aa4c-4f55-9a30-b1c53ccf9449]: (4, None) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb4611f-4005-452e-9992-f4e8d43c44ac]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f3f234-e960-4018-8840-288066bbf7bc]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260]
Oct 26 06:40:08 user nova-compute[74295]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260] successful.
Oct 26 06:40:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ede046-9a8a-494a-91da-6f10081b547d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.523s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== disconnect_volume: return (525ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:40:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:40:09 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-f70a0ca2-7b2e-4fd4-9967-288f7960b8b7 req-f225ce93-24b5-4614-ba4c-a1680297c3f7 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f70a0ca2-7b2e-4fd4-9967-288f7960b8b7 req-f225ce93-24b5-4614-ba4c-a1680297c3f7 service nova] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f70a0ca2-7b2e-4fd4-9967-288f7960b8b7 req-f225ce93-24b5-4614-ba4c-a1680297c3f7 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f70a0ca2-7b2e-4fd4-9967-288f7960b8b7 req-f225ce93-24b5-4614-ba4c-a1680297c3f7 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-f70a0ca2-7b2e-4fd4-9967-288f7960b8b7 req-f225ce93-24b5-4614-ba4c-a1680297c3f7 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] No waiting events found dispatching network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:09 user nova-compute[74295]: WARNING nova.compute.manager [req-f70a0ca2-7b2e-4fd4-9967-288f7960b8b7 req-f225ce93-24b5-4614-ba4c-a1680297c3f7 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received unexpected event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 for instance with vm_state active and task_state resize_migrating.
Oct 26 06:40:09 user nova-compute[74295]: DEBUG nova.network.neutron [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Port bc714b43-0ed1-4b49-b1f8-a5eddbf64206 binding to destination host user is already ACTIVE {{(pid=74295) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquired lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating instance_info_cache with network_info: [{"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Releasing lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG os_brick.utils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4866f94f-161e-420e-b23f-eead5cfded26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec2c707-d5cf-4da0-a898-5952cd4c5f5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1921b6a6-4745-4223-903d-7aea9c2e77f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87b0db5-ad1c-458c-be62-6a443e21c5a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:40:10 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:40:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[25835b3e-99f7-4dc0-9dec-e1787ab650fb]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:40:10 user nova-compute[74295]: DEBUG os_brick.utils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:40:11 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:11 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:40:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:12 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:12 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:40:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:40:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:40:18 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:40:18 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=6951MB free_disk=25.005252838134766GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Applying migration context for instance fe7578f8-07ed-4701-9292-9e1d10c5766c as it has an incoming, in-progress migration 2b8791c8-dfc7-42a6-8bf5-b62fcff5a5d1. Migration status is post-migrating {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 06:40:18 user nova-compute[74295]: INFO nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating resource usage from migration 2b8791c8-dfc7-42a6-8bf5-b62fcff5a5d1
Oct 26 06:40:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 0440536c-c9ad-439e-aa26-689b945c63ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d6c25b84-4b35-4086-89a5-d5f2823b507a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fb03897e-7f9e-497a-b703-ca862b11672f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c6fb7cff-07da-4441-b992-ec7fee6dd92b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1ec0a113-9297-4a51-90fc-83951205185e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 02d21159-fa28-4df3-b40b-031765d424c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Migration 2b8791c8-dfc7-42a6-8bf5-b62fcff5a5d1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fe7578f8-07ed-4701-9292-9e1d10c5766c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:40:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.751s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:40:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:40:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:22 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:24 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:40:25 user nova-compute[74295]: INFO nova.compute.manager [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Rescuing
Oct 26 06:40:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:40:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquired lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:40:25 user nova-compute[74295]: DEBUG nova.network.neutron [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:40:25 user nova-compute[74295]: DEBUG nova.network.neutron [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Updating instance_info_cache with network_info: [{"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Releasing lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-b5e0ad89-49b7-4b37-9ae3-83c60a43851f req-093772bb-4250-43ce-a8a0-391969255401 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-unplugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b5e0ad89-49b7-4b37-9ae3-83c60a43851f req-093772bb-4250-43ce-a8a0-391969255401 service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b5e0ad89-49b7-4b37-9ae3-83c60a43851f req-093772bb-4250-43ce-a8a0-391969255401 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b5e0ad89-49b7-4b37-9ae3-83c60a43851f req-093772bb-4250-43ce-a8a0-391969255401 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-b5e0ad89-49b7-4b37-9ae3-83c60a43851f req-093772bb-4250-43ce-a8a0-391969255401 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-unplugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:26 user nova-compute[74295]: WARNING nova.compute.manager [req-b5e0ad89-49b7-4b37-9ae3-83c60a43851f req-093772bb-4250-43ce-a8a0-391969255401 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-unplugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state active and task_state rescuing.
Oct 26 06:40:26 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Instance destroyed successfully.
Oct 26 06:40:26 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Attempting a stable device rescue
Oct 26 06:40:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74295) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Instance directory exists: not creating {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 06:40:26 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Creating image(s)
Oct 26 06:40:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "/opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "/opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "/opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG nova.objects.instance [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'trusted_certs' on Instance uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "9f7ae3f0ca691b982d297c706213824ed37501f5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "9f7ae3f0ca691b982d297c706213824ed37501f5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:27 user nova-compute[74295]: DEBUG nova.virt.images [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] dbbe383d-37c8-4323-bd07-ae7fceeba517 was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 06:40:27 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:40:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5.part /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5.part /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5.converted" returned: 0 in 0.259s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "9f7ae3f0ca691b982d297c706213824ed37501f5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.571s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "9f7ae3f0ca691b982d297c706213824ed37501f5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "9f7ae3f0ca691b982d297c706213824ed37501f5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-341336c4-c377-421f-94f3-dfa571639bba req-bf6642ab-28f1-4307-953e-1aff1f031ffb service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-341336c4-c377-421f-94f3-dfa571639bba req-bf6642ab-28f1-4307-953e-1aff1f031ffb service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-341336c4-c377-421f-94f3-dfa571639bba req-bf6642ab-28f1-4307-953e-1aff1f031ffb service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-341336c4-c377-421f-94f3-dfa571639bba req-bf6642ab-28f1-4307-953e-1aff1f031ffb service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-341336c4-c377-421f-94f3-dfa571639bba req-bf6642ab-28f1-4307-953e-1aff1f031ffb service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:28 user nova-compute[74295]: WARNING nova.compute.manager [req-341336c4-c377-421f-94f3-dfa571639bba req-bf6642ab-28f1-4307-953e-1aff1f031ffb service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state active and task_state rescuing.
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5 --force-share --output=json" returned: 0 in 0.189s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5,backing_fmt=raw /opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.rescue {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5,backing_fmt=raw /opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.rescue" returned: 0 in 0.060s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "9f7ae3f0ca691b982d297c706213824ed37501f5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.objects.instance [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'migration_context' on Instance uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.objects.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Start _get_guest_xml network_info=[{"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "vif_mac": "fa:16:3e:fd:af:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dbbe383d-37c8-4323-bd07-ae7fceeba517', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '16b3acec-02a3-49a5-b4f1-6c53215a019a', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvHscawf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c38de5f0-842d-4c0d-aa3d-208096993ccd', 'serial': 'c38de5f0-842d-4c0d-aa3d-208096993ccd'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.objects.instance [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'resources' on Instance uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.objects.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.objects.instance [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'numa_topology' on Instance uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.objects.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:40:28 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:40:28 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.objects.instance [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'vcpu_model' on Instance uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.objects.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvHscawf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:40:28 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:40:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:40:28 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:40:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:40:28 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf3282d-4323-40d2-95d7-77331be968f6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xvHscawf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 06:40:28 user nova-compute[74295]: node.name = iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:40:28 user nova-compute[74295]: node.tpgt = -1
Oct 26 06:40:28 user nova-compute[74295]: node.startup = automatic
Oct 26 06:40:28 user nova-compute[74295]: node.leading_login = No
Oct 26 06:40:28 user nova-compute[74295]: iface.iscsi_ifacename = default
Oct 26 06:40:28 user nova-compute[74295]: iface.net_ifacename = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.ipaddress = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.prefix_len = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.hwaddress = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.transport_name = tcp
Oct 26 06:40:28 user nova-compute[74295]: iface.initiatorname = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.state = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.vlan_id = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.vlan_priority = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.vlan_state = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.iface_num = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.mtu = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.port = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.bootproto = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.subnet_mask = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.gateway = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.dhcp_alt_client_id = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.dhcp_dns = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.dhcp_learn_iqn = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.dhcp_vendor_id_state = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.dhcp_vendor_id = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.dhcp_slp_da = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.fragmentation = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.gratuitous_arp = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.incoming_forwarding = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.tos_state = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.tos = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.ttl = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.delayed_ack = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.tcp_nagle = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.tcp_wsf_state = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.tcp_wsf = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.tcp_timer_scale = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.tcp_timestamp = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.redirect = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.def_task_mgmt_timeout = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.header_digest = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.data_digest = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.immediate_data = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.initial_r2t = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.data_seq_inorder = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.data_pdu_inorder = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.erl = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.max_receive_data_len = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.first_burst_len = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.max_outstanding_r2t = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.max_burst_len = 0
Oct 26 06:40:28 user nova-compute[74295]: iface.chap_auth = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.bidi_chap = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.strict_login_compliance = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.discovery_auth = <empty>
Oct 26 06:40:28 user nova-compute[74295]: iface.discovery_logout = <empty>
Oct 26 06:40:28 user nova-compute[74295]: node.discovery_address = <empty>
Oct 26 06:40:28 user nova-compute[74295]: node.discovery_port = 0
Oct 26 06:40:28 user nova-compute[74295]: node.discovery_type = static
Oct 26 06:40:28 user nova-compute[74295]: node.session.initial_cmdsn = 0
Oct 26 06:40:28 user nova-compute[74295]: node.session.initial_login_retry_max = 8
Oct 26 06:40:28 user nova-compute[74295]: node.session.xmit_thread_priority = -20
Oct 26 06:40:28 user nova-compute[74295]: node.session.cmds_max = 128
Oct 26 06:40:28 user nova-compute[74295]: node.session.queue_depth = 32
Oct 26 06:40:28 user nova-compute[74295]: node.session.nr_sessions = 1
Oct 26 06:40:28 user nova-compute[74295]: node.session.auth.authmethod = CHAP
Oct 26 06:40:28 user nova-compute[74295]: node.session.auth.username = xvHscawf
Oct 26 06:40:28 user nova-compute[74295]: node.session.auth.password = ***
Oct 26 06:40:28 user nova-compute[74295]: node.session.auth.username_in = <empty>
Oct 26 06:40:28 user nova-compute[74295]: node.session.auth.password_in = <empty>
Oct 26 06:40:28 user nova-compute[74295]: node.session.auth.chap_algs = MD5
Oct 26 06:40:28 user nova-compute[74295]: node.session.timeo.replacement_timeout = 120
Oct 26 06:40:28 user nova-compute[74295]: node.session.err_timeo.abort_timeout = 15
Oct 26 06:40:28 user nova-compute[74295]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 06:40:28 user nova-compute[74295]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 06:40:28 user nova-compute[74295]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.FastAbort = Yes
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.InitialR2T = No
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.ImmediateData = Yes
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.MaxConnections = 1
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 06:40:28 user nova-compute[74295]: node.session.iscsi.ERL = 0
Oct 26 06:40:28 user nova-compute[74295]: node.session.scan = manual
Oct 26 06:40:28 user nova-compute[74295]: node.session.reopen_max = 0
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].address = 172.16.0.220
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].port = 3260
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].startup = manual
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].tcp.window_size = 524288
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].tcp.type_of_service = 0
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].timeo.logout_timeout = 15
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].timeo.login_timeout = 15
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].timeo.auth_timeout = 45
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].iscsi.DataDigest = None
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].iscsi.IFMarker = No
Oct 26 06:40:28 user nova-compute[74295]: node.conn[0].iscsi.OFMarker = No
Oct 26 06:40:28 user nova-compute[74295]: # END RECORD
Oct 26 06:40:28 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a6fda7-b61e-48f5-8727-7395d8959250]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c5286-47bf-4b24-a2cd-716404596f99]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvHscawf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvHscawf" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b118d-caf7-4180-b32b-230131d68bb6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xvHscawf'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3699c133-8f13-4700-af1f-271602cd6e38]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f801412-0858-40ae-be3b-7e4a082a65ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:40:29 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:40:29 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:40:29 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:40:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:40:29 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:40:29 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:40:29 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:40:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] HCTL ('34', '0', '0', 0) found on session 28 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9008b56a-bd63-497a-bdf6-520895bc029e]: (4, ('0 0 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Searching for a device in session 28 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvHscawf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '23763303839616532', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763303839616532', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-90833333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-90833333',id=26,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:38:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-9hmvlt98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:38:34Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "vif_mac": "fa:16:3e:fd:af:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "vif_mac": "fa:16:3e:fd:af:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:af:21,bridge_name='br-int',has_traffic_filtering=True,id=67ebefae-3edf-4872-85a7-afa6222db4df,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ebefae-3e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.objects.instance [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'pci_devices' on Instance uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.objects.base [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Object Instance<29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:40:29 user nova-compute[74295]:   <uuid>29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7</uuid>
Oct 26 06:40:29 user nova-compute[74295]:   <name>instance-0000001a</name>
Oct 26 06:40:29 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:40:29 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:40:29 user nova-compute[74295]:   <metadata>
Oct 26 06:40:29 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:40:29 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:40:29 user nova-compute[74295]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-90833333</nova:name>
Oct 26 06:40:29 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:40:28</nova:creationTime>
Oct 26 06:40:29 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:40:29 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:40:29 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:40:29 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:40:29 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:40:29 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:40:29 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:40:29 user nova-compute[74295]:       <nova:owner>
Oct 26 06:40:29 user nova-compute[74295]:         <nova:user uuid="969b88effa7b4c14a9fdca34760804e8">tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member</nova:user>
Oct 26 06:40:29 user nova-compute[74295]:         <nova:project uuid="e0ac89a741e94482bf18b56aca6a53c1">tempest-ServerBootFromVolumeStableRescueTest-1259261992</nova:project>
Oct 26 06:40:29 user nova-compute[74295]:       </nova:owner>
Oct 26 06:40:29 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:40:29 user nova-compute[74295]:       <nova:ports>
Oct 26 06:40:29 user nova-compute[74295]:         <nova:port uuid="67ebefae-3edf-4872-85a7-afa6222db4df">
Oct 26 06:40:29 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 06:40:29 user nova-compute[74295]:         </nova:port>
Oct 26 06:40:29 user nova-compute[74295]:       </nova:ports>
Oct 26 06:40:29 user nova-compute[74295]:     </nova:instance>
Oct 26 06:40:29 user nova-compute[74295]:   </metadata>
Oct 26 06:40:29 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:40:29 user nova-compute[74295]:     <system>
Oct 26 06:40:29 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:40:29 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:40:29 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:40:29 user nova-compute[74295]:       <entry name="serial">29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7</entry>
Oct 26 06:40:29 user nova-compute[74295]:       <entry name="uuid">29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7</entry>
Oct 26 06:40:29 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:40:29 user nova-compute[74295]:     </system>
Oct 26 06:40:29 user nova-compute[74295]:   </sysinfo>
Oct 26 06:40:29 user nova-compute[74295]:   <os>
Oct 26 06:40:29 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:40:29 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:40:29 user nova-compute[74295]:   </os>
Oct 26 06:40:29 user nova-compute[74295]:   <features>
Oct 26 06:40:29 user nova-compute[74295]:     <acpi/>
Oct 26 06:40:29 user nova-compute[74295]:     <apic/>
Oct 26 06:40:29 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:40:29 user nova-compute[74295]:   </features>
Oct 26 06:40:29 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:40:29 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:40:29 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:40:29 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:40:29 user nova-compute[74295]:   </clock>
Oct 26 06:40:29 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:40:29 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:40:29 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:40:29 user nova-compute[74295]:   </cpu>
Oct 26 06:40:29 user nova-compute[74295]:   <devices>
Oct 26 06:40:29 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:40:29 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:40:29 user nova-compute[74295]:       <source dev="/dev/sdc"/>
Oct 26 06:40:29 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:40:29 user nova-compute[74295]:       <serial>c38de5f0-842d-4c0d-aa3d-208096993ccd</serial>
Oct 26 06:40:29 user nova-compute[74295]:     </disk>
Oct 26 06:40:29 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:40:29 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:40:29 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.rescue"/>
Oct 26 06:40:29 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:40:29 user nova-compute[74295]:       <boot order="1"/>
Oct 26 06:40:29 user nova-compute[74295]:     </disk>
Oct 26 06:40:29 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:40:29 user nova-compute[74295]:       <mac address="fa:16:3e:fd:af:21"/>
Oct 26 06:40:29 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:40:29 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:40:29 user nova-compute[74295]:       <target dev="tap67ebefae-3e"/>
Oct 26 06:40:29 user nova-compute[74295]:     </interface>
Oct 26 06:40:29 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:40:29 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/console.log" append="off"/>
Oct 26 06:40:29 user nova-compute[74295]:     </serial>
Oct 26 06:40:29 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:40:29 user nova-compute[74295]:     <video>
Oct 26 06:40:29 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:40:29 user nova-compute[74295]:     </video>
Oct 26 06:40:29 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:40:29 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:40:29 user nova-compute[74295]:     </rng>
Oct 26 06:40:29 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:40:29 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:40:29 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:40:29 user nova-compute[74295]:     </memballoon>
Oct 26 06:40:29 user nova-compute[74295]:   </devices>
Oct 26 06:40:29 user nova-compute[74295]: </domain>
Oct 26 06:40:29 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:40:29 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Instance destroyed successfully.
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:40:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] No VIF found with MAC fa:16:3e:fd:af:21, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-233c2c4a-854d-45af-99ec-9f329544ac9b req-e9107904-6e9d-41aa-8d1b-d6ab1a747bf4 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-233c2c4a-854d-45af-99ec-9f329544ac9b req-e9107904-6e9d-41aa-8d1b-d6ab1a747bf4 service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-233c2c4a-854d-45af-99ec-9f329544ac9b req-e9107904-6e9d-41aa-8d1b-d6ab1a747bf4 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-233c2c4a-854d-45af-99ec-9f329544ac9b req-e9107904-6e9d-41aa-8d1b-d6ab1a747bf4 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-233c2c4a-854d-45af-99ec-9f329544ac9b req-e9107904-6e9d-41aa-8d1b-d6ab1a747bf4 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:30 user nova-compute[74295]: WARNING nova.compute.manager [req-233c2c4a-854d-45af-99ec-9f329544ac9b req-e9107904-6e9d-41aa-8d1b-d6ab1a747bf4 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state active and task_state rescuing.
Oct 26 06:40:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-412d85ce-cc96-466c-abe7-2da85fd02b4b req-d3643fb8-841c-428a-9d65-02ac4f8d2f7a service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-412d85ce-cc96-466c-abe7-2da85fd02b4b req-d3643fb8-841c-428a-9d65-02ac4f8d2f7a service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-412d85ce-cc96-466c-abe7-2da85fd02b4b req-d3643fb8-841c-428a-9d65-02ac4f8d2f7a service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-412d85ce-cc96-466c-abe7-2da85fd02b4b req-d3643fb8-841c-428a-9d65-02ac4f8d2f7a service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-412d85ce-cc96-466c-abe7-2da85fd02b4b req-d3643fb8-841c-428a-9d65-02ac4f8d2f7a service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:32 user nova-compute[74295]: WARNING nova.compute.manager [req-412d85ce-cc96-466c-abe7-2da85fd02b4b req-d3643fb8-841c-428a-9d65-02ac4f8d2f7a service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state active and task_state rescuing.
Oct 26 06:40:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-98a80fc0-e842-44c4-9ea7-1cfe42ea731b tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:40:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:40:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "0440536c-c9ad-439e-aa26-689b945c63ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "0440536c-c9ad-439e-aa26-689b945c63ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:38 user nova-compute[74295]: INFO nova.compute.manager [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Terminating instance
Oct 26 06:40:38 user nova-compute[74295]: DEBUG nova.compute.manager [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-fd522281-5f9c-430f-a980-858a7b737a22 req-3c054e6b-6ca3-4f04-a223-67a218f5c46c service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received event network-vif-unplugged-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fd522281-5f9c-430f-a980-858a7b737a22 req-3c054e6b-6ca3-4f04-a223-67a218f5c46c service nova] Acquiring lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fd522281-5f9c-430f-a980-858a7b737a22 req-3c054e6b-6ca3-4f04-a223-67a218f5c46c service nova] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-fd522281-5f9c-430f-a980-858a7b737a22 req-3c054e6b-6ca3-4f04-a223-67a218f5c46c service nova] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-fd522281-5f9c-430f-a980-858a7b737a22 req-3c054e6b-6ca3-4f04-a223-67a218f5c46c service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] No waiting events found dispatching network-vif-unplugged-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-fd522281-5f9c-430f-a980-858a7b737a22 req-3c054e6b-6ca3-4f04-a223-67a218f5c46c service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received event network-vif-unplugged-91fed54a-b08d-47ca-a309-e7d098954c85 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Instance destroyed successfully.
Oct 26 06:40:39 user nova-compute[74295]: DEBUG nova.objects.instance [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lazy-loading 'resources' on Instance uuid 0440536c-c9ad-439e-aa26-689b945c63ea {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-746197758',display_name='tempest-ServersNegativeTestJSON-server-746197758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-746197758',id=17,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:31:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beceb88c1357495f9a2a600dc7bbfa1f',ramdisk_id='',reservation_id='r-hdr4kelk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-274276408',owner_user_name='tempest-ServersNegativeTestJSON-274276408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:31:38Z,user_data=None,user_id='91925e095e034d3cb49445f191f910b1',uuid=0440536c-c9ad-439e-aa26-689b945c63ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converting VIF {"id": "91fed54a-b08d-47ca-a309-e7d098954c85", "address": "fa:16:3e:56:50:7b", "network": {"id": "65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-211349815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beceb88c1357495f9a2a600dc7bbfa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91fed54a-b0", "ovs_interfaceid": "91fed54a-b08d-47ca-a309-e7d098954c85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=91fed54a-b08d-47ca-a309-e7d098954c85,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91fed54a-b0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG os_vif [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=91fed54a-b08d-47ca-a309-e7d098954c85,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91fed54a-b0') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91fed54a-b0, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22d647c2-2732-4a22-b23d-b4c3c1f16cbe) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:40:39 user nova-compute[74295]: INFO os_vif [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:50:7b,bridge_name='br-int',has_traffic_filtering=True,id=91fed54a-b08d-47ca-a309-e7d098954c85,network=Network(65a1ee8a-d2e8-4ca0-92b8-c83f67e3a928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91fed54a-b0')
Oct 26 06:40:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Deleting instance files /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea_del
Oct 26 06:40:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Deletion of /opt/stack/data/nova/instances/0440536c-c9ad-439e-aa26-689b945c63ea_del complete
Oct 26 06:40:39 user nova-compute[74295]: INFO nova.compute.manager [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 26 06:40:39 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:40:39 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-d6dfc915-6f67-4827-912b-f8a3aedf24c1 req-74f51605-215b-4c38-90ac-d5419d6b47d2 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-changed-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-d6dfc915-6f67-4827-912b-f8a3aedf24c1 req-74f51605-215b-4c38-90ac-d5419d6b47d2 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Refreshing instance network info cache due to event network-changed-5bd6bb7e-c803-4e38-a749-33e26c969d0b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d6dfc915-6f67-4827-912b-f8a3aedf24c1 req-74f51605-215b-4c38-90ac-d5419d6b47d2 service nova] Acquiring lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d6dfc915-6f67-4827-912b-f8a3aedf24c1 req-74f51605-215b-4c38-90ac-d5419d6b47d2 service nova] Acquired lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG nova.network.neutron [req-d6dfc915-6f67-4827-912b-f8a3aedf24c1 req-74f51605-215b-4c38-90ac-d5419d6b47d2 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Refreshing network info cache for port 5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:40:40 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Took 0.59 seconds to deallocate network for instance.
Oct 26 06:40:40 user nova-compute[74295]: DEBUG nova.network.neutron [req-d6dfc915-6f67-4827-912b-f8a3aedf24c1 req-74f51605-215b-4c38-90ac-d5419d6b47d2 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updated VIF entry in instance network info cache for port 5bd6bb7e-c803-4e38-a749-33e26c969d0b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG nova.network.neutron [req-d6dfc915-6f67-4827-912b-f8a3aedf24c1 req-74f51605-215b-4c38-90ac-d5419d6b47d2 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d6dfc915-6f67-4827-912b-f8a3aedf24c1 req-74f51605-215b-4c38-90ac-d5419d6b47d2 service nova] Releasing lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:40:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:41 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Deleted allocations for instance 0440536c-c9ad-439e-aa26-689b945c63ea
Oct 26 06:40:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-666631a5-2e4a-4cf4-b872-1f4a652fb282 tempest-ServersNegativeTestJSON-274276408 tempest-ServersNegativeTestJSON-274276408-project-member] Lock "0440536c-c9ad-439e-aa26-689b945c63ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.246s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:41 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:40:41 user nova-compute[74295]: INFO nova.compute.manager [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] instance snapshotting
Oct 26 06:40:41 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Beginning live snapshot process
Oct 26 06:40:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-685f50af-fd6e-4106-86d1-37cbfdf5873c req-76c43b08-0fbe-45f7-86d2-0055d0624ab8 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received event network-vif-plugged-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-685f50af-fd6e-4106-86d1-37cbfdf5873c req-76c43b08-0fbe-45f7-86d2-0055d0624ab8 service nova] Acquiring lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-685f50af-fd6e-4106-86d1-37cbfdf5873c req-76c43b08-0fbe-45f7-86d2-0055d0624ab8 service nova] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-685f50af-fd6e-4106-86d1-37cbfdf5873c req-76c43b08-0fbe-45f7-86d2-0055d0624ab8 service nova] Lock "0440536c-c9ad-439e-aa26-689b945c63ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-685f50af-fd6e-4106-86d1-37cbfdf5873c req-76c43b08-0fbe-45f7-86d2-0055d0624ab8 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] No waiting events found dispatching network-vif-plugged-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:41 user nova-compute[74295]: WARNING nova.compute.manager [req-685f50af-fd6e-4106-86d1-37cbfdf5873c req-76c43b08-0fbe-45f7-86d2-0055d0624ab8 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received unexpected event network-vif-plugged-91fed54a-b08d-47ca-a309-e7d098954c85 for instance with vm_state deleted and task_state None.
Oct 26 06:40:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json -f qcow2 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json -f qcow2 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpadcxpn58/85ef8cce9e1e4df1839fd6458bede80d.delta 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpadcxpn58/85ef8cce9e1e4df1839fd6458bede80d.delta 1073741824" returned: 0 in 0.052s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:42 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 06:40:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-b97f7360-11b6-4e1c-9c6a-47f5e5452f8c req-5fa446fe-c90d-4c90-898b-4e2764326e50 service nova] [instance: 0440536c-c9ad-439e-aa26-689b945c63ea] Received event network-vif-deleted-91fed54a-b08d-47ca-a309-e7d098954c85 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] COPY block job progress, current cursor: 262144 final cursor: 75497472 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:40:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74295) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 06:40:43 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 06:40:43 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:40:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpadcxpn58/85ef8cce9e1e4df1839fd6458bede80d.delta /opt/stack/data/nova/instances/snapshots/tmpadcxpn58/85ef8cce9e1e4df1839fd6458bede80d {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpadcxpn58/85ef8cce9e1e4df1839fd6458bede80d.delta /opt/stack/data/nova/instances/snapshots/tmpadcxpn58/85ef8cce9e1e4df1839fd6458bede80d" returned: 0 in 0.357s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:43 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Snapshot extracted, beginning image upload
Oct 26 06:40:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Starting finish_migration {{(pid=74295) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Instance directory exists: not creating {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 06:40:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Creating image(s)
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Ensure instance console log exists: /opt/stack/data/nova/instances/fe7578f8-07ed-4701-9292-9e1d10c5766c/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Start _get_guest_xml network_info=[{"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-131214272-network", "vif_mac": "fa:16:3e:af:83:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'f9465173-f067-4d07-bf11-ccc5a4356c38', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oABNVibs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fe7578f8-07ed-4701-9292-9e1d10c5766c', 'attached_at': '2023-10-26T06:40:46.000000', 'detached_at': '', 'volume_id': '6e085787-63b6-4668-a1fe-1f4ef8729af3', 'serial': '6e085787-63b6-4668-a1fe-1f4ef8729af3'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:40:46 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:40:46 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oABNVibs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:40:46 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:40:46 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:40:46 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[612c2a63-1cf9-4221-ab65-fd8edb8755a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:40:46 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[474b4b72-d345-4997-94ac-6b525d092c9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3] added
Oct 26 06:40:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a4d344-bcd0-4fbd-b3d8-cc6d458369f7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96b7b82-5772-417d-aba2-d4192d4f5b21]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oABNVibs {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oABNVibs" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f58a83a-c979-4f05-997c-3d479f1cd0ff]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oABNVibs'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ea3874-af14-4f8e-a90f-c50ded637e69]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[19247cd5-2eea-4aaf-9fe1-b748e202f6b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b37c7fd-021a-4fe0-9596-bfe4620869a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260]
Oct 26 06:40:46 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260] successful.
Oct 26 06:40:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Snapshot image upload complete
Oct 26 06:40:46 user nova-compute[74295]: INFO nova.compute.manager [None req-a2cfe7d9-967a-46e4-98d9-4e2d5bde7f7c tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Took 5.55 seconds to snapshot the instance on the hypervisor.
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd5c3de-898f-4a71-9be5-9de9a5eba5d8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f02094-b215-4a78-8cd6-f4f60165b5ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:40:46 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3479076-5d5e-4877-a516-a5e7b9a1a8a0]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oABNVibs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-f7e7883b-a29e-4820-9d05-483f93ee4a73 req-9fd03b61-d068-48f8-bb44-78bf05ef7217 service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received event network-changed-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-f7e7883b-a29e-4820-9d05-483f93ee4a73 req-9fd03b61-d068-48f8-bb44-78bf05ef7217 service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Refreshing instance network info cache due to event network-changed-fe72cf72-4a62-4633-9d46-a030363c03d8. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f7e7883b-a29e-4820-9d05-483f93ee4a73 req-9fd03b61-d068-48f8-bb44-78bf05ef7217 service nova] Acquiring lock "refresh_cache-f6d582e2-2c02-45b3-bac6-fb63c09c5344" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f7e7883b-a29e-4820-9d05-483f93ee4a73 req-9fd03b61-d068-48f8-bb44-78bf05ef7217 service nova] Acquired lock "refresh_cache-f6d582e2-2c02-45b3-bac6-fb63c09c5344" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:40:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-f7e7883b-a29e-4820-9d05-483f93ee4a73 req-9fd03b61-d068-48f8-bb44-78bf05ef7217 service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Refreshing network info cache for port fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.network.neutron [req-f7e7883b-a29e-4820-9d05-483f93ee4a73 req-9fd03b61-d068-48f8-bb44-78bf05ef7217 service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Updated VIF entry in instance network info cache for port fe72cf72-4a62-4633-9d46-a030363c03d8. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.network.neutron [req-f7e7883b-a29e-4820-9d05-483f93ee4a73 req-9fd03b61-d068-48f8-bb44-78bf05ef7217 service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Updating instance_info_cache with network_info: [{"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f7e7883b-a29e-4820-9d05-483f93ee4a73 req-9fd03b61-d068-48f8-bb44-78bf05ef7217 service nova] Releasing lock "refresh_cache-f6d582e2-2c02-45b3-bac6-fb63c09c5344" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23532353137616563', 'path': '/dev/sde'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532353137616563', 'path': '/dev/sde'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-805152837',display_name='tempest-ServerActionsTestOtherA-server-805152837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-805152837',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEalUstBq4vFH7qnNchfBeKikF9/lcUlFw9j5QYSoSoqdNDpcgRH/nIAEmyjwdsmFPjVTLPazAWFfDhK1wvnJyZTilappqjUYF52/w6x/BiOg104d9g3zNtJX38DMWLdw==',key_name='tempest-keypair-977042820',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:38:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-vy2gwlqf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=fe7578f8-07ed-4701-9292-9e1d10c5766c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-131214272-network", "vif_mac": "fa:16:3e:af:83:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-131214272-network", "vif_mac": "fa:16:3e:af:83:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:40:47 user nova-compute[74295]:   <uuid>fe7578f8-07ed-4701-9292-9e1d10c5766c</uuid>
Oct 26 06:40:47 user nova-compute[74295]:   <name>instance-0000001b</name>
Oct 26 06:40:47 user nova-compute[74295]:   <memory>2097152</memory>
Oct 26 06:40:47 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:40:47 user nova-compute[74295]:   <metadata>
Oct 26 06:40:47 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:40:47 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:40:47 user nova-compute[74295]:       <nova:name>tempest-ServerActionsTestOtherA-server-805152837</nova:name>
Oct 26 06:40:47 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:40:46</nova:creationTime>
Oct 26 06:40:47 user nova-compute[74295]:       <nova:flavor name="m1.small">
Oct 26 06:40:47 user nova-compute[74295]:         <nova:memory>2048</nova:memory>
Oct 26 06:40:47 user nova-compute[74295]:         <nova:disk>20</nova:disk>
Oct 26 06:40:47 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:40:47 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:40:47 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:40:47 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:40:47 user nova-compute[74295]:       <nova:owner>
Oct 26 06:40:47 user nova-compute[74295]:         <nova:user uuid="e3c3d6fa25d143bc935e7e16275aac57">tempest-ServerActionsTestOtherA-911482981-project-member</nova:user>
Oct 26 06:40:47 user nova-compute[74295]:         <nova:project uuid="83b6035868e347c4b90651f3ad73237a">tempest-ServerActionsTestOtherA-911482981</nova:project>
Oct 26 06:40:47 user nova-compute[74295]:       </nova:owner>
Oct 26 06:40:47 user nova-compute[74295]:       <nova:ports>
Oct 26 06:40:47 user nova-compute[74295]:         <nova:port uuid="bc714b43-0ed1-4b49-b1f8-a5eddbf64206">
Oct 26 06:40:47 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 06:40:47 user nova-compute[74295]:         </nova:port>
Oct 26 06:40:47 user nova-compute[74295]:       </nova:ports>
Oct 26 06:40:47 user nova-compute[74295]:     </nova:instance>
Oct 26 06:40:47 user nova-compute[74295]:   </metadata>
Oct 26 06:40:47 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:40:47 user nova-compute[74295]:     <system>
Oct 26 06:40:47 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:40:47 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:40:47 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:40:47 user nova-compute[74295]:       <entry name="serial">fe7578f8-07ed-4701-9292-9e1d10c5766c</entry>
Oct 26 06:40:47 user nova-compute[74295]:       <entry name="uuid">fe7578f8-07ed-4701-9292-9e1d10c5766c</entry>
Oct 26 06:40:47 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:40:47 user nova-compute[74295]:     </system>
Oct 26 06:40:47 user nova-compute[74295]:   </sysinfo>
Oct 26 06:40:47 user nova-compute[74295]:   <os>
Oct 26 06:40:47 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:40:47 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:40:47 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:40:47 user nova-compute[74295]:   </os>
Oct 26 06:40:47 user nova-compute[74295]:   <features>
Oct 26 06:40:47 user nova-compute[74295]:     <acpi/>
Oct 26 06:40:47 user nova-compute[74295]:     <apic/>
Oct 26 06:40:47 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:40:47 user nova-compute[74295]:   </features>
Oct 26 06:40:47 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:40:47 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:40:47 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:40:47 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:40:47 user nova-compute[74295]:   </clock>
Oct 26 06:40:47 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:40:47 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:40:47 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:40:47 user nova-compute[74295]:   </cpu>
Oct 26 06:40:47 user nova-compute[74295]:   <devices>
Oct 26 06:40:47 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:40:47 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:40:47 user nova-compute[74295]:       <source dev="/dev/sde"/>
Oct 26 06:40:47 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:40:47 user nova-compute[74295]:       <serial>6e085787-63b6-4668-a1fe-1f4ef8729af3</serial>
Oct 26 06:40:47 user nova-compute[74295]:     </disk>
Oct 26 06:40:47 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:40:47 user nova-compute[74295]:       <mac address="fa:16:3e:af:83:c7"/>
Oct 26 06:40:47 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:40:47 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:40:47 user nova-compute[74295]:       <target dev="tapbc714b43-0e"/>
Oct 26 06:40:47 user nova-compute[74295]:     </interface>
Oct 26 06:40:47 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:40:47 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/fe7578f8-07ed-4701-9292-9e1d10c5766c/console.log" append="off"/>
Oct 26 06:40:47 user nova-compute[74295]:     </serial>
Oct 26 06:40:47 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:40:47 user nova-compute[74295]:     <video>
Oct 26 06:40:47 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:40:47 user nova-compute[74295]:     </video>
Oct 26 06:40:47 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:40:47 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:40:47 user nova-compute[74295]:     </rng>
Oct 26 06:40:47 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:40:47 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:40:47 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:40:47 user nova-compute[74295]:     </memballoon>
Oct 26 06:40:47 user nova-compute[74295]:   </devices>
Oct 26 06:40:47 user nova-compute[74295]: </domain>
Oct 26 06:40:47 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-805152837',display_name='tempest-ServerActionsTestOtherA-server-805152837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-805152837',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEalUstBq4vFH7qnNchfBeKikF9/lcUlFw9j5QYSoSoqdNDpcgRH/nIAEmyjwdsmFPjVTLPazAWFfDhK1wvnJyZTilappqjUYF52/w6x/BiOg104d9g3zNtJX38DMWLdw==',key_name='tempest-keypair-977042820',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:38:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-vy2gwlqf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=fe7578f8-07ed-4701-9292-9e1d10c5766c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-131214272-network", "vif_mac": "fa:16:3e:af:83:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-131214272-network", "vif_mac": "fa:16:3e:af:83:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG os_vif [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cab1200c-6995-59b1-ad27-23e98b74e181', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc714b43-0e, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc714b43-0e, col_values=(('qos', UUID('be21c76a-cf60-4167-ad83-ab533bd17f9d')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc714b43-0e, col_values=(('external_ids', {'iface-id': 'bc714b43-0ed1-4b49-b1f8-a5eddbf64206', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:83:c7', 'vm-uuid': 'fe7578f8-07ed-4701-9292-9e1d10c5766c'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:47 user nova-compute[74295]: INFO os_vif [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e')
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:40:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] No VIF found with MAC fa:16:3e:af:83:c7, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-89ba475c-799d-449f-95cb-eb52ac42b8fe req-a8f2c7cf-d237-4e94-b61e-a78b03bcf235 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-89ba475c-799d-449f-95cb-eb52ac42b8fe req-a8f2c7cf-d237-4e94-b61e-a78b03bcf235 service nova] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-89ba475c-799d-449f-95cb-eb52ac42b8fe req-a8f2c7cf-d237-4e94-b61e-a78b03bcf235 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-89ba475c-799d-449f-95cb-eb52ac42b8fe req-a8f2c7cf-d237-4e94-b61e-a78b03bcf235 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-89ba475c-799d-449f-95cb-eb52ac42b8fe req-a8f2c7cf-d237-4e94-b61e-a78b03bcf235 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] No waiting events found dispatching network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:49 user nova-compute[74295]: WARNING nova.compute.manager [req-89ba475c-799d-449f-95cb-eb52ac42b8fe req-a8f2c7cf-d237-4e94-b61e-a78b03bcf235 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received unexpected event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 for instance with vm_state active and task_state resize_finish.
Oct 26 06:40:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-e3c6a6ec-3192-467d-a7b5-e91541d54c97 req-8baa1bc6-2620-42e7-a5d3-464aaafebfa4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e3c6a6ec-3192-467d-a7b5-e91541d54c97 req-8baa1bc6-2620-42e7-a5d3-464aaafebfa4 service nova] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e3c6a6ec-3192-467d-a7b5-e91541d54c97 req-8baa1bc6-2620-42e7-a5d3-464aaafebfa4 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e3c6a6ec-3192-467d-a7b5-e91541d54c97 req-8baa1bc6-2620-42e7-a5d3-464aaafebfa4 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-e3c6a6ec-3192-467d-a7b5-e91541d54c97 req-8baa1bc6-2620-42e7-a5d3-464aaafebfa4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] No waiting events found dispatching network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:40:51 user nova-compute[74295]: WARNING nova.compute.manager [req-e3c6a6ec-3192-467d-a7b5-e91541d54c97 req-8baa1bc6-2620-42e7-a5d3-464aaafebfa4 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received unexpected event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 for instance with vm_state active and task_state resize_finish.
Oct 26 06:40:51 user nova-compute[74295]: DEBUG nova.compute.manager [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:40:51 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Instance running successfully.
Oct 26 06:40:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Failed to set time: agent not configured {{(pid=74295) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 06:40:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-01ebe45b-e09a-4ca4-b15e-fc1fb5335569 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] finish_migration finished successfully. {{(pid=74295) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 06:40:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG nova.objects.instance [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'flavor' on Instance uuid f6d582e2-2c02-45b3-bac6-fb63c09c5344 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:53 user nova-compute[74295]: INFO nova.compute.manager [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Attaching volume 279f1d4a-f708-4776-86ff-007a044930a6 to /dev/vdb
Oct 26 06:40:53 user nova-compute[74295]: DEBUG os_brick.utils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81d30c6-a940-4a5b-a8f6-6aa09c70aa34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d589af8-7e11-4052-a3e6-31da5bdbdbba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[071f3e73-43ac-4913-8484-873e9de65546]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[63db8354-ff4a-433a-9af3-8c69df09d60c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:40:53 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:40:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1b18a0-b13e-4707-9fd0-f4f7983d7440]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG os_brick.utils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:40:53 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Updating existing volume attachment record: 0168f32d-6e20-402c-b27c-d3d64105c02c {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:40:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-3e861432-2a56-4d0a-b29b-f0b2781ebe2f req-9e280368-8dd7-4175-9f77-f0cd0f917497 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-changed-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-3e861432-2a56-4d0a-b29b-f0b2781ebe2f req-9e280368-8dd7-4175-9f77-f0cd0f917497 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Refreshing instance network info cache due to event network-changed-775a3f05-426c-473c-a0ce-499522370ef9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3e861432-2a56-4d0a-b29b-f0b2781ebe2f req-9e280368-8dd7-4175-9f77-f0cd0f917497 service nova] Acquiring lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3e861432-2a56-4d0a-b29b-f0b2781ebe2f req-9e280368-8dd7-4175-9f77-f0cd0f917497 service nova] Acquired lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-3e861432-2a56-4d0a-b29b-f0b2781ebe2f req-9e280368-8dd7-4175-9f77-f0cd0f917497 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Refreshing network info cache for port 775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:40:58 user nova-compute[74295]: INFO nova.compute.manager [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Detaching volume e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc
Oct 26 06:40:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-3e861432-2a56-4d0a-b29b-f0b2781ebe2f req-9e280368-8dd7-4175-9f77-f0cd0f917497 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updated VIF entry in instance network info cache for port 775a3f05-426c-473c-a0ce-499522370ef9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-3e861432-2a56-4d0a-b29b-f0b2781ebe2f req-9e280368-8dd7-4175-9f77-f0cd0f917497 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updating instance_info_cache with network_info: [{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3e861432-2a56-4d0a-b29b-f0b2781ebe2f req-9e280368-8dd7-4175-9f77-f0cd0f917497 service nova] Releasing lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:40:58 user nova-compute[74295]: INFO nova.virt.block_device [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Attempting to driver detach volume e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc from mountpoint /dev/vdb
Oct 26 06:40:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Attempting to detach device vdb from instance d6c25b84-4b35-4086-89a5-d5f2823b507a from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:40:58 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:40:58 user nova-compute[74295]:   <source dev="/dev/sdh"/>
Oct 26 06:40:58 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:40:58 user nova-compute[74295]:   <serial>e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc</serial>
Oct 26 06:40:58 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:40:58 user nova-compute[74295]: </disk>
Oct 26 06:40:58 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:40:58 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Successfully detached device vdb from instance d6c25b84-4b35-4086-89a5-d5f2823b507a from the persistent domain config.
Oct 26 06:40:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6c25b84-4b35-4086-89a5-d5f2823b507a from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:40:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:40:58 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:40:58 user nova-compute[74295]:   <source dev="/dev/sdh"/>
Oct 26 06:40:58 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:40:58 user nova-compute[74295]:   <serial>e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc</serial>
Oct 26 06:40:58 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:40:58 user nova-compute[74295]: </disk>
Oct 26 06:40:58 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:40:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:40:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-56850d2c-7e0f-4a56-8717-afd8b98989f2 req-13f0dd4d-86f5-47fd-aa7f-2527aaf400e5 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-changed-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-56850d2c-7e0f-4a56-8717-afd8b98989f2 req-13f0dd4d-86f5-47fd-aa7f-2527aaf400e5 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Refreshing instance network info cache due to event network-changed-775a3f05-426c-473c-a0ce-499522370ef9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:41:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56850d2c-7e0f-4a56-8717-afd8b98989f2 req-13f0dd4d-86f5-47fd-aa7f-2527aaf400e5 service nova] Acquiring lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56850d2c-7e0f-4a56-8717-afd8b98989f2 req-13f0dd4d-86f5-47fd-aa7f-2527aaf400e5 service nova] Acquired lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-56850d2c-7e0f-4a56-8717-afd8b98989f2 req-13f0dd4d-86f5-47fd-aa7f-2527aaf400e5 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Refreshing network info cache for port 775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:41:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-56850d2c-7e0f-4a56-8717-afd8b98989f2 req-13f0dd4d-86f5-47fd-aa7f-2527aaf400e5 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updated VIF entry in instance network info cache for port 775a3f05-426c-473c-a0ce-499522370ef9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:41:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-56850d2c-7e0f-4a56-8717-afd8b98989f2 req-13f0dd4d-86f5-47fd-aa7f-2527aaf400e5 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updating instance_info_cache with network_info: [{"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56850d2c-7e0f-4a56-8717-afd8b98989f2 req-13f0dd4d-86f5-47fd-aa7f-2527aaf400e5 service nova] Releasing lock "refresh_cache-d6c25b84-4b35-4086-89a5-d5f2823b507a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:10 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:41:10 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:41:11 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:41:11 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:41:11 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvjLsJMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:41:12 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:41:12 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:41:12 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6cc1d1-5135-45d7-a81f-06929df4284a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:41:12 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6609dd4-7a7d-4c0e-bdb8-bb6020f7fb1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6] added
Oct 26 06:41:12 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1eea7e-eb87-44bc-b9e0-9ebcea6f705a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f182a1a-e4fc-4949-a866-2650ea423889]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvjLsJMg {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvjLsJMg" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e6ebed-34dd-4c1e-846a-7ad3260607e3]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IvjLsJMg'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b763957-df02-4f4f-bcc0-dece67d76175]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b890ea6-dd7d-4f73-b08a-1052a8c16cdb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:12 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:41:12 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:12 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:41:12 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:12 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb7511a-8e65-44ba-89d2-d7f6fbc27da0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6, portal: 172.16.0.220,3260]
Oct 26 06:41:13 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6, portal: 172.16.0.220,3260] successful.
Oct 26 06:41:13 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8977d07-dc16-4b23-9b86-31a9a28cd99a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02415f5-0d70-47fa-8e7f-fe9760093c4b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)
Oct 26 06:41:13 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[148d3685-92db-4f9c-aa9a-bafb668b435e]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:41:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvjLsJMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23533316331393866', 'path': '/dev/sdf'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533316331393866', 'path': '/dev/sdf'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG nova.objects.instance [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'flavor' on Instance uuid f6d582e2-2c02-45b3-bac6-fb63c09c5344 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:41:14 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:41:14 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:41:14 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:41:14 user nova-compute[74295]:   <serial>279f1d4a-f708-4776-86ff-007a044930a6</serial>
Oct 26 06:41:14 user nova-compute[74295]: </disk>
Oct 26 06:41:14 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No VIF found with MAC fa:16:3e:9c:3a:1f, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a655f5e1-0ed7-4541-880b-c9dc572d0790 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.671s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:16 user nova-compute[74295]: INFO nova.compute.manager [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Detaching volume 279f1d4a-f708-4776-86ff-007a044930a6
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:16 user nova-compute[74295]: INFO nova.virt.block_device [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Attempting to driver detach volume 279f1d4a-f708-4776-86ff-007a044930a6 from mountpoint /dev/vdb
Oct 26 06:41:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Attempting to detach device vdb from instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:41:16 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:41:16 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:41:16 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:41:16 user nova-compute[74295]:   <serial>279f1d4a-f708-4776-86ff-007a044930a6</serial>
Oct 26 06:41:16 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:41:16 user nova-compute[74295]: </disk>
Oct 26 06:41:16 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:41:16 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully detached device vdb from instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 from the persistent domain config.
Oct 26 06:41:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:41:16 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:41:16 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:41:16 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:41:16 user nova-compute[74295]:   <serial>279f1d4a-f708-4776-86ff-007a044930a6</serial>
Oct 26 06:41:16 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:41:16 user nova-compute[74295]: </disk>
Oct 26 06:41:16 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:41:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6c25b84-4b35-4086-89a5-d5f2823b507a is timed out.
Oct 26 06:41:19 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Successfully detached device vdb from instance d6c25b84-4b35-4086-89a5-d5f2823b507a from the live domain config.
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDUPAapz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:41:19 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[af14f074-9009-45f8-9743-b1741b8707b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:41:19 user nova-compute[74295]: No targets found.
Oct 26 06:41:19 user nova-compute[74295]: iSNS:
Oct 26 06:41:19 user nova-compute[74295]: No targets found.
Oct 26 06:41:19 user nova-compute[74295]: STATIC:
Oct 26 06:41:19 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc
Oct 26 06:41:19 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:19 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:19 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3
Oct 26 06:41:19 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:19 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:19 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:41:19 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:19 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:19 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433
Oct 26 06:41:19 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:19 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:19 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:41:19 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:19 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:19 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6
Oct 26 06:41:19 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:19 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:19 user nova-compute[74295]: FIRMWARE:
Oct 26 06:41:19 user nova-compute[74295]: No targets found.
Oct 26 06:41:19 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:41:19 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:41:19 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e21ce1-9ba1-4d85-bcf1-7976cbb2e421]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c3212-93d7-4ad2-bfa5-0d9405e268bd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)
Oct 26 06:41:19 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:19 user nova-compute[74295]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)
Oct 26 06:41:19 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1be830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc'): ({'sdh'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Removing single pathed devices sdh {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1939cf5b-dc38-4d65-8b5e-1d641cb0bee2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d276d7-5d91-4683-b05a-063129894f09]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Flushing IO for device /dev/sdh {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a16697-bfe5-4f08-a20b-7ec05a0f7c9f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a2f10-907e-4ffa-bc57-935e7398430b]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] SCSI volumes sdh have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8694060-c28c-4387-8c1c-879c0bc8c41a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9874cfea-2fd3-4101-a200-2511b6840f34]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc, portal: 172.16.0.220,3260]
Oct 26 06:41:19 user nova-compute[74295]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc, portal: 172.16.0.220,3260] successful.
Oct 26 06:41:19 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:19 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:41:19 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7015MB free_disk=24.87517547607422GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53843eb-b6c0-4c19-8f2a-e0c74bfdeecc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[386b9e41-fc74-48b0-8c13-5e71984f4aa6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.682s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] <== disconnect_volume: return (684ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Applying migration context for instance fe7578f8-07ed-4701-9292-9e1d10c5766c as it has an incoming, in-progress migration 2b8791c8-dfc7-42a6-8bf5-b62fcff5a5d1. Migration status is finished {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 06:41:19 user nova-compute[74295]: INFO nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating resource usage from migration 2b8791c8-dfc7-42a6-8bf5-b62fcff5a5d1
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d6c25b84-4b35-4086-89a5-d5f2823b507a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fb03897e-7f9e-497a-b703-ca862b11672f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c6fb7cff-07da-4441-b992-ec7fee6dd92b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1ec0a113-9297-4a51-90fc-83951205185e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 02d21159-fa28-4df3-b40b-031765d424c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Migration 2b8791c8-dfc7-42a6-8bf5-b62fcff5a5d1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fe7578f8-07ed-4701-9292-9e1d10c5766c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:41:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:41:20 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:41:20 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:41:20 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:41:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:20 user nova-compute[74295]: DEBUG nova.objects.instance [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'flavor' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ef2a6def-57d1-49c9-a4c3-f609911c946f tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.207s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c002695d-145c-4e74-90ae-aa1133680472] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid c002695d-145c-4e74-90ae-aa1133680472 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updating instance_info_cache with network_info: [{"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-c002695d-145c-4e74-90ae-aa1133680472" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:41:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:41:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:41:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:41:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:41:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:41:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:41:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-a22a6621-9af9-4b17-91fe-c4e4bf3c2b1c req-d65bfa75-b906-44aa-9980-5ae94321266d service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-a22a6621-9af9-4b17-91fe-c4e4bf3c2b1c req-d65bfa75-b906-44aa-9980-5ae94321266d service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing instance network info cache due to event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a22a6621-9af9-4b17-91fe-c4e4bf3c2b1c req-d65bfa75-b906-44aa-9980-5ae94321266d service nova] Acquiring lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a22a6621-9af9-4b17-91fe-c4e4bf3c2b1c req-d65bfa75-b906-44aa-9980-5ae94321266d service nova] Acquired lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG nova.network.neutron [req-a22a6621-9af9-4b17-91fe-c4e4bf3c2b1c req-d65bfa75-b906-44aa-9980-5ae94321266d service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG nova.network.neutron [req-a22a6621-9af9-4b17-91fe-c4e4bf3c2b1c req-d65bfa75-b906-44aa-9980-5ae94321266d service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updated VIF entry in instance network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG nova.network.neutron [req-a22a6621-9af9-4b17-91fe-c4e4bf3c2b1c req-d65bfa75-b906-44aa-9980-5ae94321266d service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating instance_info_cache with network_info: [{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a22a6621-9af9-4b17-91fe-c4e4bf3c2b1c req-d65bfa75-b906-44aa-9980-5ae94321266d service nova] Releasing lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:30 user nova-compute[74295]: INFO nova.compute.manager [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Shelve offloading
Oct 26 06:41:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-e18b63b8-7b61-49c1-8357-845ce929a3b3 req-3c413b9d-8041-4544-bcec-e837f05e4507 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-unplugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e18b63b8-7b61-49c1-8357-845ce929a3b3 req-3c413b9d-8041-4544-bcec-e837f05e4507 service nova] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e18b63b8-7b61-49c1-8357-845ce929a3b3 req-3c413b9d-8041-4544-bcec-e837f05e4507 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e18b63b8-7b61-49c1-8357-845ce929a3b3 req-3c413b9d-8041-4544-bcec-e837f05e4507 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-e18b63b8-7b61-49c1-8357-845ce929a3b3 req-3c413b9d-8041-4544-bcec-e837f05e4507 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] No waiting events found dispatching network-vif-unplugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:41:30 user nova-compute[74295]: WARNING nova.compute.manager [req-e18b63b8-7b61-49c1-8357-845ce929a3b3 req-3c413b9d-8041-4544-bcec-e837f05e4507 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received unexpected event network-vif-unplugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f for instance with vm_state active and task_state shelving.
Oct 26 06:41:31 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Instance destroyed successfully.
Oct 26 06:41:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:41:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquired lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:31 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:41:31 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating instance_info_cache with network_info: [{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Releasing lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:32 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Instance destroyed successfully.
Oct 26 06:41:32 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lazy-loading 'resources' on Instance uuid c6fb7cff-07da-4441-b992-ec7fee6dd92b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1080291082',display_name='tempest-TestShelveInstance-server-1080291082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1080291082',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHyyG9m2+qncT6D1l6xWi4NskP03lOdp11CJoUdl4QeqjSIivDvMBGZjdN4UqF+ClnuoDFBAyJyYZR2dkI7HjbKWL4pWkBTTPctPMX9xmRxYo8i2qIKW03GWZiibLqVLg==',key_name='tempest-TestShelveInstance-1955889839',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1200573404a43989ba88c780574ffb4',ramdisk_id='',reservation_id='r-wt3jzqse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-930828987',owner_user_name='tempest-TestShelveInstance-930828987-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:39:40Z,user_data=None,user_id='030acfa99577474290cf4fe7e3aa7ed2',uuid=c6fb7cff-07da-4441-b992-ec7fee6dd92b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converting VIF {"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_vif [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ecd91eb-3d, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-ae168b8a-cdb2-4640-b841-5f0be26f4135 req-41f1f830-b273-46fb-bcbb-a64de7ee7d74 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-ae168b8a-cdb2-4640-b841-5f0be26f4135 req-41f1f830-b273-46fb-bcbb-a64de7ee7d74 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing instance network info cache due to event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ae168b8a-cdb2-4640-b841-5f0be26f4135 req-41f1f830-b273-46fb-bcbb-a64de7ee7d74 service nova] Acquiring lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ae168b8a-cdb2-4640-b841-5f0be26f4135 req-41f1f830-b273-46fb-bcbb-a64de7ee7d74 service nova] Acquired lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG nova.network.neutron [req-ae168b8a-cdb2-4640-b841-5f0be26f4135 req-41f1f830-b273-46fb-bcbb-a64de7ee7d74 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=469219d6-b289-4f18-9996-41721c617c6c) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:32 user nova-compute[74295]: INFO os_vif [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d')
Oct 26 06:41:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuWserJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:41:32 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[18676115-2a37-448e-8716-dd53e08a5722]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:41:32 user nova-compute[74295]: No targets found.
Oct 26 06:41:32 user nova-compute[74295]: iSNS:
Oct 26 06:41:32 user nova-compute[74295]: No targets found.
Oct 26 06:41:32 user nova-compute[74295]: STATIC:
Oct 26 06:41:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3
Oct 26 06:41:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:41:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433
Oct 26 06:41:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:41:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:32 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6
Oct 26 06:41:32 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:32 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:32 user nova-compute[74295]: FIRMWARE:
Oct 26 06:41:32 user nova-compute[74295]: No targets found.
Oct 26 06:41:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:41:32 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:41:32 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[82860dff-ed36-48f6-ae65-91275a6b138f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2e8590-a498-4fec-9553-b33c4bd77768]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:32 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:32 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:41:32 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:32 user nova-compute[74295]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)
Oct 26 06:41:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:32 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:32 user nova-compute[74295]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:41:32 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:32 user nova-compute[74295]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)
Oct 26 06:41:32 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f358855dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74a0d0f-d7a2-4965-b7ca-e20a48b7ba85]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3603af36-1e00-4833-a79d-65d778fd065c]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bacf0b-9dc4-4b46-b789-91a076322d73]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[da954f3c-76d4-4053-ba57-d6b1da3be262]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[39115800-0f96-4d72-91b5-dd0e246d69a7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --logout" returned: 0 in 0.157s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad7132-8652-4d07-8107-43c137a4ad30]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260]
Oct 26 06:41:33 user nova-compute[74295]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260] successful.
Oct 26 06:41:33 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ca18d-12c7-4e94-805b-29ff6aecd387]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] <== disconnect_volume: return (423ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:41:33 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Deleting instance files /opt/stack/data/nova/instances/c6fb7cff-07da-4441-b992-ec7fee6dd92b_del
Oct 26 06:41:33 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Deletion of /opt/stack/data/nova/instances/c6fb7cff-07da-4441-b992-ec7fee6dd92b_del complete
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.network.neutron [req-ae168b8a-cdb2-4640-b841-5f0be26f4135 req-41f1f830-b273-46fb-bcbb-a64de7ee7d74 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updated VIF entry in instance network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.network.neutron [req-ae168b8a-cdb2-4640-b841-5f0be26f4135 req-41f1f830-b273-46fb-bcbb-a64de7ee7d74 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating instance_info_cache with network_info: [{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": null, "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ae168b8a-cdb2-4640-b841-5f0be26f4135 req-41f1f830-b273-46fb-bcbb-a64de7ee7d74 service nova] Releasing lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "6988db00-49d1-44d4-b383-7c52a2c2faf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-7622fa53-1deb-4a95-be13-f8f778255bee req-06e6aa41-a31b-4094-8f94-ab9eebe60c25 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7622fa53-1deb-4a95-be13-f8f778255bee req-06e6aa41-a31b-4094-8f94-ab9eebe60c25 service nova] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7622fa53-1deb-4a95-be13-f8f778255bee req-06e6aa41-a31b-4094-8f94-ab9eebe60c25 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7622fa53-1deb-4a95-be13-f8f778255bee req-06e6aa41-a31b-4094-8f94-ab9eebe60c25 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-7622fa53-1deb-4a95-be13-f8f778255bee req-06e6aa41-a31b-4094-8f94-ab9eebe60c25 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] No waiting events found dispatching network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:41:33 user nova-compute[74295]: WARNING nova.compute.manager [req-7622fa53-1deb-4a95-be13-f8f778255bee req-06e6aa41-a31b-4094-8f94-ab9eebe60c25 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received unexpected event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f for instance with vm_state active and task_state shelving.
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:41:33 user nova-compute[74295]: INFO nova.compute.claims [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Claim successful on node user
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:41:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:41:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:41:34 user nova-compute[74295]: INFO nova.virt.block_device [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Booting with volume snapshot a59adab5-81d5-43d3-9a3d-042d2799f0f8 at /dev/vda
Oct 26 06:41:34 user nova-compute[74295]: DEBUG nova.policy [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f8c68bbe2245c6b6f159c45e006216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe63ca1f244085963c38b864dff1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:41:34 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Deleted allocations for instance c6fb7cff-07da-4441-b992-ec7fee6dd92b
Oct 26 06:41:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lazy-loading 'numa_topology' on Instance uuid c6fb7cff-07da-4441-b992-ec7fee6dd92b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG nova.objects.base [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Object Instance<c6fb7cff-07da-4441-b992-ec7fee6dd92b> lazy-loaded attributes: resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Successfully created port: 62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5280261b-dd44-4a17-a176-738663426a06 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.223s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG nova.network.neutron [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Successfully updated port: 62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "refresh_cache-6988db00-49d1-44d4-b383-7c52a2c2faf7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquired lock "refresh_cache-6988db00-49d1-44d4-b383-7c52a2c2faf7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG nova.network.neutron [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG nova.network.neutron [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-1923bfdf-b106-403f-952d-eb3fe279c7a9 req-5dab5107-3adc-4e89-82f7-b12e40c05030 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received event network-changed-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-1923bfdf-b106-403f-952d-eb3fe279c7a9 req-5dab5107-3adc-4e89-82f7-b12e40c05030 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Refreshing instance network info cache due to event network-changed-62cc71c1-d718-453c-9df5-befb0c32e3ee. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1923bfdf-b106-403f-952d-eb3fe279c7a9 req-5dab5107-3adc-4e89-82f7-b12e40c05030 service nova] Acquiring lock "refresh_cache-6988db00-49d1-44d4-b383-7c52a2c2faf7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG nova.network.neutron [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Updating instance_info_cache with network_info: [{"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Releasing lock "refresh_cache-6988db00-49d1-44d4-b383-7c52a2c2faf7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Instance network_info: |[{"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1923bfdf-b106-403f-952d-eb3fe279c7a9 req-5dab5107-3adc-4e89-82f7-b12e40c05030 service nova] Acquired lock "refresh_cache-6988db00-49d1-44d4-b383-7c52a2c2faf7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:35 user nova-compute[74295]: DEBUG nova.network.neutron [req-1923bfdf-b106-403f-952d-eb3fe279c7a9 req-5dab5107-3adc-4e89-82f7-b12e40c05030 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Refreshing network info cache for port 62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG nova.network.neutron [req-1923bfdf-b106-403f-952d-eb3fe279c7a9 req-5dab5107-3adc-4e89-82f7-b12e40c05030 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Updated VIF entry in instance network info cache for port 62cc71c1-d718-453c-9df5-befb0c32e3ee. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG nova.network.neutron [req-1923bfdf-b106-403f-952d-eb3fe279c7a9 req-5dab5107-3adc-4e89-82f7-b12e40c05030 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Updating instance_info_cache with network_info: [{"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-1923bfdf-b106-403f-952d-eb3fe279c7a9 req-5dab5107-3adc-4e89-82f7-b12e40c05030 service nova] Releasing lock "refresh_cache-6988db00-49d1-44d4-b383-7c52a2c2faf7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:36 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 is timed out.
Oct 26 06:41:36 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully detached device vdb from instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 from the live domain config.
Oct 26 06:41:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvjLsJMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:41:36 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:41:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6982ace-2612-4837-bb43-079db0d1f485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:41:36 user nova-compute[74295]: No targets found.
Oct 26 06:41:36 user nova-compute[74295]: iSNS:
Oct 26 06:41:36 user nova-compute[74295]: No targets found.
Oct 26 06:41:36 user nova-compute[74295]: STATIC:
Oct 26 06:41:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3
Oct 26 06:41:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:41:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:41:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6
Oct 26 06:41:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:41:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:41:36 user nova-compute[74295]: FIRMWARE:
Oct 26 06:41:36 user nova-compute[74295]: No targets found.
Oct 26 06:41:36 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:41:36 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:41:36 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdfcb3e-66bf-4cdd-8377-d211d12e0b04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f200747d-2188-4605-a788-4854e7725258]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:37 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:37 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:37 user nova-compute[74295]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)
Oct 26 06:41:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:41:37 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:41:37 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:41:37 user nova-compute[74295]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 (non-flash)
Oct 26 06:41:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1ee8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6'): ({'sdf'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Removing single pathed devices sdf {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbace417-f5e5-4564-96ae-53e969829452]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[db62aea1-61d8-449d-891b-8c17cff2cbad]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flushing IO for device /dev/sdf {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e465fe-d5ad-42ba-b81e-e647522eb4e6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb03bf8-44b9-4504-9e42-5705017a0b50]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[19374094-a8d3-4e55-a5a4-e62fa1080b48]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9236903-cf31-4f4f-832b-2142fc1f9089]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6, portal: 172.16.0.220,3260]
Oct 26 06:41:37 user nova-compute[74295]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6, portal: 172.16.0.220,3260] successful.
Oct 26 06:41:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279f1d4a-f708-4776-86ff-007a044930a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e81f08-8010-45fb-b948-e61c46489354]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] <== disconnect_volume: return (356ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:38 user nova-compute[74295]: DEBUG nova.objects.instance [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'flavor' on Instance uuid f6d582e2-2c02-45b3-bac6-fb63c09c5344 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-8e2ed714-30ca-4766-ac6c-8a82cdac7005 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.062s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG os_brick.utils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbaab00-8011-4162-b0bc-b0037a513fed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a4428a-ac33-4af2-9ffa-0e291237bd05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-47b9f1a5-0210-445d-a756-f378b2d4f028 req-6473e526-5c22-48f9-826b-ca864a2c14ac service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received event network-changed-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-47b9f1a5-0210-445d-a756-f378b2d4f028 req-6473e526-5c22-48f9-826b-ca864a2c14ac service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Refreshing instance network info cache due to event network-changed-7e4de530-6d56-4e35-a1b7-cbb3746ede9d. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-47b9f1a5-0210-445d-a756-f378b2d4f028 req-6473e526-5c22-48f9-826b-ca864a2c14ac service nova] Acquiring lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-47b9f1a5-0210-445d-a756-f378b2d4f028 req-6473e526-5c22-48f9-826b-ca864a2c14ac service nova] Acquired lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG nova.network.neutron [req-47b9f1a5-0210-445d-a756-f378b2d4f028 req-6473e526-5c22-48f9-826b-ca864a2c14ac service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Refreshing network info cache for port 7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c4aa60-3a49-4430-b04c-70efd276efc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9004c0b-4179-4a90-812c-da70dfe3570f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:41:39 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:41:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c9eee0-b3de-4f76-a4b5-ab967c3ca843]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG os_brick.utils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:41:39 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Updating existing volume attachment record: b259ae11-87b7-40c8-96fb-126a21f76eb1 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG nova.objects.instance [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'flavor' on Instance uuid 02d21159-fa28-4df3-b40b-031765d424c2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:40 user nova-compute[74295]: INFO nova.compute.manager [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Attaching volume b733717f-d1e2-441b-b5bf-44ec214b8cce to /dev/vdb
Oct 26 06:41:40 user nova-compute[74295]: DEBUG os_brick.utils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG nova.network.neutron [req-47b9f1a5-0210-445d-a756-f378b2d4f028 req-6473e526-5c22-48f9-826b-ca864a2c14ac service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Updated VIF entry in instance network info cache for port 7e4de530-6d56-4e35-a1b7-cbb3746ede9d. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG nova.network.neutron [req-47b9f1a5-0210-445d-a756-f378b2d4f028 req-6473e526-5c22-48f9-826b-ca864a2c14ac service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Updating instance_info_cache with network_info: [{"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e55c00-8e05-4a12-920d-5b4ac7932d82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-47b9f1a5-0210-445d-a756-f378b2d4f028 req-6473e526-5c22-48f9-826b-ca864a2c14ac service nova] Releasing lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce1934d-8947-4f40-8d78-a0e6673631d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[14df41f0-c339-4c71-8e8d-479377809cde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[899e2fac-60fc-4544-b450-cd5944b5d2f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:41:40 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:41:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[480b76fd-adca-4e02-80fb-f6158efd37cb]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG os_brick.utils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:41:40 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Updating existing volume attachment record: 80fb5551-d8bc-44ff-9caa-b963a5c03191 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:41:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:41:44 user nova-compute[74295]: INFO nova.compute.claims [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Claim successful on node user
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:41:44 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.policy [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c0aa0cb8a174036bb890dca38df6e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f36efc5cdc4cf5a61b0807a1235ba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:41:44 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Creating image(s)
Oct 26 06:41:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "/opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "/opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "/opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.168s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk 1073741824" returned: 0 in 0.052s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Successfully created port: f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Cannot resize image /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Ensure instance console log exists: /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Successfully updated port: f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquired lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-f4e0c55a-e495-4e17-bf53-3cd1616276f1 req-46e185cb-c878-4527-9161-3ebaa149dc27 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-changed-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-f4e0c55a-e495-4e17-bf53-3cd1616276f1 req-46e185cb-c878-4527-9161-3ebaa149dc27 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Refreshing instance network info cache due to event network-changed-f4dc83bc-fc9b-437c-a72c-e3f765165204. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f4e0c55a-e495-4e17-bf53-3cd1616276f1 req-46e185cb-c878-4527-9161-3ebaa149dc27 service nova] Acquiring lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updating instance_info_cache with network_info: [{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Releasing lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance network_info: |[{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f4e0c55a-e495-4e17-bf53-3cd1616276f1 req-46e185cb-c878-4527-9161-3ebaa149dc27 service nova] Acquired lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-f4e0c55a-e495-4e17-bf53-3cd1616276f1 req-46e185cb-c878-4527-9161-3ebaa149dc27 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Refreshing network info cache for port f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Start _get_guest_xml network_info=[{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:41:46 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:41:46 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1591415229',display_name='tempest-AttachVolumeTestJSON-server-1591415229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1591415229',id=33,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7JNBP8TyOuHsG10l/IfSBEWSkkEP86O+W7m1eIwVlzmm7l/gSpZcL5vTicjil3gUPq4t2iOoKKXCyzOLUfkbOoS1QhygvZVkpBJuD4Uq8O5dAEL94jKzDS+1L+rw6ypA==',key_name='tempest-keypair-1584679424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-io9ajpiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=d05fad65-dd3a-4a04-8b42-f81313c4aca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.objects.instance [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'pci_devices' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:41:46 user nova-compute[74295]:   <uuid>d05fad65-dd3a-4a04-8b42-f81313c4aca4</uuid>
Oct 26 06:41:46 user nova-compute[74295]:   <name>instance-00000021</name>
Oct 26 06:41:46 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:41:46 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:41:46 user nova-compute[74295]:   <metadata>
Oct 26 06:41:46 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:41:46 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:41:46 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeTestJSON-server-1591415229</nova:name>
Oct 26 06:41:46 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:41:46</nova:creationTime>
Oct 26 06:41:46 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:41:46 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:41:46 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:41:46 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:41:46 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:41:46 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:41:46 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:41:46 user nova-compute[74295]:       <nova:owner>
Oct 26 06:41:46 user nova-compute[74295]:         <nova:user uuid="7c0aa0cb8a174036bb890dca38df6e7d">tempest-AttachVolumeTestJSON-93311543-project-member</nova:user>
Oct 26 06:41:46 user nova-compute[74295]:         <nova:project uuid="b5f36efc5cdc4cf5a61b0807a1235ba4">tempest-AttachVolumeTestJSON-93311543</nova:project>
Oct 26 06:41:46 user nova-compute[74295]:       </nova:owner>
Oct 26 06:41:46 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:41:46 user nova-compute[74295]:       <nova:ports>
Oct 26 06:41:46 user nova-compute[74295]:         <nova:port uuid="f4dc83bc-fc9b-437c-a72c-e3f765165204">
Oct 26 06:41:46 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 06:41:46 user nova-compute[74295]:         </nova:port>
Oct 26 06:41:46 user nova-compute[74295]:       </nova:ports>
Oct 26 06:41:46 user nova-compute[74295]:     </nova:instance>
Oct 26 06:41:46 user nova-compute[74295]:   </metadata>
Oct 26 06:41:46 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:41:46 user nova-compute[74295]:     <system>
Oct 26 06:41:46 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:41:46 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:41:46 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:41:46 user nova-compute[74295]:       <entry name="serial">d05fad65-dd3a-4a04-8b42-f81313c4aca4</entry>
Oct 26 06:41:46 user nova-compute[74295]:       <entry name="uuid">d05fad65-dd3a-4a04-8b42-f81313c4aca4</entry>
Oct 26 06:41:46 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:41:46 user nova-compute[74295]:     </system>
Oct 26 06:41:46 user nova-compute[74295]:   </sysinfo>
Oct 26 06:41:46 user nova-compute[74295]:   <os>
Oct 26 06:41:46 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:41:46 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:41:46 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:41:46 user nova-compute[74295]:   </os>
Oct 26 06:41:46 user nova-compute[74295]:   <features>
Oct 26 06:41:46 user nova-compute[74295]:     <acpi/>
Oct 26 06:41:46 user nova-compute[74295]:     <apic/>
Oct 26 06:41:46 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:41:46 user nova-compute[74295]:   </features>
Oct 26 06:41:46 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:41:46 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:41:46 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:41:46 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:41:46 user nova-compute[74295]:   </clock>
Oct 26 06:41:46 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:41:46 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:41:46 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:41:46 user nova-compute[74295]:   </cpu>
Oct 26 06:41:46 user nova-compute[74295]:   <devices>
Oct 26 06:41:46 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:41:46 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:41:46 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk"/>
Oct 26 06:41:46 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:41:46 user nova-compute[74295]:     </disk>
Oct 26 06:41:46 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:41:46 user nova-compute[74295]:       <mac address="fa:16:3e:ba:0d:a5"/>
Oct 26 06:41:46 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:41:46 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:41:46 user nova-compute[74295]:       <target dev="tapf4dc83bc-fc"/>
Oct 26 06:41:46 user nova-compute[74295]:     </interface>
Oct 26 06:41:46 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:41:46 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/console.log" append="off"/>
Oct 26 06:41:46 user nova-compute[74295]:     </serial>
Oct 26 06:41:46 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:41:46 user nova-compute[74295]:     <video>
Oct 26 06:41:46 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:41:46 user nova-compute[74295]:     </video>
Oct 26 06:41:46 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:41:46 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:41:46 user nova-compute[74295]:     </rng>
Oct 26 06:41:46 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:41:46 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:41:46 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:41:46 user nova-compute[74295]:     </memballoon>
Oct 26 06:41:46 user nova-compute[74295]:   </devices>
Oct 26 06:41:46 user nova-compute[74295]: </domain>
Oct 26 06:41:46 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1591415229',display_name='tempest-AttachVolumeTestJSON-server-1591415229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1591415229',id=33,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7JNBP8TyOuHsG10l/IfSBEWSkkEP86O+W7m1eIwVlzmm7l/gSpZcL5vTicjil3gUPq4t2iOoKKXCyzOLUfkbOoS1QhygvZVkpBJuD4Uq8O5dAEL94jKzDS+1L+rw6ypA==',key_name='tempest-keypair-1584679424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-io9ajpiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=d05fad65-dd3a-4a04-8b42-f81313c4aca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG os_vif [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dbc58bd-f29a-5a04-adee-e1f09d442357', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4dc83bc-fc, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4dc83bc-fc, col_values=(('qos', UUID('d82e1e6e-9e46-4cdb-bc91-b202807fd556')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4dc83bc-fc, col_values=(('external_ids', {'iface-id': 'f4dc83bc-fc9b-437c-a72c-e3f765165204', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:0d:a5', 'vm-uuid': 'd05fad65-dd3a-4a04-8b42-f81313c4aca4'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:46 user nova-compute[74295]: INFO os_vif [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc')
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No VIF found with MAC fa:16:3e:ba:0d:a5, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-f4e0c55a-e495-4e17-bf53-3cd1616276f1 req-46e185cb-c878-4527-9161-3ebaa149dc27 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updated VIF entry in instance network info cache for port f4dc83bc-fc9b-437c-a72c-e3f765165204. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-f4e0c55a-e495-4e17-bf53-3cd1616276f1 req-46e185cb-c878-4527-9161-3ebaa149dc27 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updating instance_info_cache with network_info: [{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f4e0c55a-e495-4e17-bf53-3cd1616276f1 req-46e185cb-c878-4527-9161-3ebaa149dc27 service nova] Releasing lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-3cc0df7b-33a1-42fa-8f75-3df0a45208a7 req-ab6a6ac9-5a2c-44e5-855a-4e42a4b83337 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3cc0df7b-33a1-42fa-8f75-3df0a45208a7 req-ab6a6ac9-5a2c-44e5-855a-4e42a4b83337 service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3cc0df7b-33a1-42fa-8f75-3df0a45208a7 req-ab6a6ac9-5a2c-44e5-855a-4e42a4b83337 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3cc0df7b-33a1-42fa-8f75-3df0a45208a7 req-ab6a6ac9-5a2c-44e5-855a-4e42a4b83337 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-3cc0df7b-33a1-42fa-8f75-3df0a45208a7 req-ab6a6ac9-5a2c-44e5-855a-4e42a4b83337 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:41:48 user nova-compute[74295]: WARNING nova.compute.manager [req-3cc0df7b-33a1-42fa-8f75-3df0a45208a7 req-ab6a6ac9-5a2c-44e5-855a-4e42a4b83337 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state building and task_state spawning.
Oct 26 06:41:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:49 user nova-compute[74295]: INFO nova.compute.manager [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Terminating instance
Oct 26 06:41:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-473037fb-9ba8-4da3-8fdc-aaca47b8b3cd req-011d38d7-f771-4b4e-b589-3ee2ce70bc13 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-unplugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-473037fb-9ba8-4da3-8fdc-aaca47b8b3cd req-011d38d7-f771-4b4e-b589-3ee2ce70bc13 service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-473037fb-9ba8-4da3-8fdc-aaca47b8b3cd req-011d38d7-f771-4b4e-b589-3ee2ce70bc13 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-473037fb-9ba8-4da3-8fdc-aaca47b8b3cd req-011d38d7-f771-4b4e-b589-3ee2ce70bc13 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-473037fb-9ba8-4da3-8fdc-aaca47b8b3cd req-011d38d7-f771-4b4e-b589-3ee2ce70bc13 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-unplugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-473037fb-9ba8-4da3-8fdc-aaca47b8b3cd req-011d38d7-f771-4b4e-b589-3ee2ce70bc13 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-unplugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Instance destroyed successfully.
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'resources' on Instance uuid d6c25b84-4b35-4086-89a5-d5f2823b507a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1292363646',display_name='tempest-ServerRescueNegativeTestJSON-server-1292363646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1292363646',id=23,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsTZlJheNp8sVuhOrIqG8qdNLOjdx64RyRTKV9E6RNWLg7CAdzx3HBr741A9mhH3N1E6pyKCeBiyizgQdHyyg0KibIFZPr7FeQmHvdsblnqk/03y+0vGoXBplYR2DLKNA==',key_name='tempest-keypair-61692672',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:37:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-c6l7dwko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:39:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b0e86cf3ec049a58aee69c427717598',uuid=d6c25b84-4b35-4086-89a5-d5f2823b507a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "775a3f05-426c-473c-a0ce-499522370ef9", "address": "fa:16:3e:a1:3f:72", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775a3f05-42", "ovs_interfaceid": "775a3f05-426c-473c-a0ce-499522370ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3f:72,bridge_name='br-int',has_traffic_filtering=True,id=775a3f05-426c-473c-a0ce-499522370ef9,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775a3f05-42') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG os_vif [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3f:72,bridge_name='br-int',has_traffic_filtering=True,id=775a3f05-426c-473c-a0ce-499522370ef9,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775a3f05-42') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap775a3f05-42, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=060e1a03-3afb-4413-b469-d5fd99870079) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:41:50 user nova-compute[74295]: INFO os_vif [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3f:72,bridge_name='br-int',has_traffic_filtering=True,id=775a3f05-426c-473c-a0ce-499522370ef9,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775a3f05-42')
Oct 26 06:41:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Deleting instance files /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a_del
Oct 26 06:41:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Deletion of /opt/stack/data/nova/instances/d6c25b84-4b35-4086-89a5-d5f2823b507a_del complete
Oct 26 06:41:50 user nova-compute[74295]: INFO nova.compute.manager [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 26 06:41:50 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-21f838f6-129b-4886-95e6-eabc68178030 req-ab822768-487a-4ec5-be58-5caaa5a19c51 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-21f838f6-129b-4886-95e6-eabc68178030 req-ab822768-487a-4ec5-be58-5caaa5a19c51 service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-21f838f6-129b-4886-95e6-eabc68178030 req-ab822768-487a-4ec5-be58-5caaa5a19c51 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-21f838f6-129b-4886-95e6-eabc68178030 req-ab822768-487a-4ec5-be58-5caaa5a19c51 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-21f838f6-129b-4886-95e6-eabc68178030 req-ab822768-487a-4ec5-be58-5caaa5a19c51 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:41:50 user nova-compute[74295]: WARNING nova.compute.manager [req-21f838f6-129b-4886-95e6-eabc68178030 req-ab822768-487a-4ec5-be58-5caaa5a19c51 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state building and task_state spawning.
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:41:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance spawned successfully.
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:41:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:41:51 user nova-compute[74295]: INFO nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Took 6.10 seconds to spawn the instance on the hypervisor.
Oct 26 06:41:51 user nova-compute[74295]: DEBUG nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:51 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Took 0.76 seconds to deallocate network for instance.
Oct 26 06:41:51 user nova-compute[74295]: INFO nova.compute.manager [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Took 7.10 seconds to build instance.
Oct 26 06:41:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-333567c7-2f7e-40be-a0c6-6995bdb55af6 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.239s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-dd09441f-4f0b-41fd-95b7-ab8a303ecea7 req-ba693e8f-3c79-4876-a377-a4f2ff3c3036 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dd09441f-4f0b-41fd-95b7-ab8a303ecea7 req-ba693e8f-3c79-4876-a377-a4f2ff3c3036 service nova] Acquiring lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dd09441f-4f0b-41fd-95b7-ab8a303ecea7 req-ba693e8f-3c79-4876-a377-a4f2ff3c3036 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dd09441f-4f0b-41fd-95b7-ab8a303ecea7 req-ba693e8f-3c79-4876-a377-a4f2ff3c3036 service nova] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-dd09441f-4f0b-41fd-95b7-ab8a303ecea7 req-ba693e8f-3c79-4876-a377-a4f2ff3c3036 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] No waiting events found dispatching network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:41:51 user nova-compute[74295]: WARNING nova.compute.manager [req-dd09441f-4f0b-41fd-95b7-ab8a303ecea7 req-ba693e8f-3c79-4876-a377-a4f2ff3c3036 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received unexpected event network-vif-plugged-775a3f05-426c-473c-a0ce-499522370ef9 for instance with vm_state deleted and task_state None.
Oct 26 06:41:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-dd09441f-4f0b-41fd-95b7-ab8a303ecea7 req-ba693e8f-3c79-4876-a377-a4f2ff3c3036 service nova] [instance: d6c25b84-4b35-4086-89a5-d5f2823b507a] Received event network-vif-deleted-775a3f05-426c-473c-a0ce-499522370ef9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:41:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:51 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Deleted allocations for instance d6c25b84-4b35-4086-89a5-d5f2823b507a
Oct 26 06:41:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c5d659f4-c835-4f61-85eb-4217d4d32799 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "d6c25b84-4b35-4086-89a5-d5f2823b507a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Going to confirm migration 2 {{(pid=74295) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquired lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'info_cache' on Instance uuid fe7578f8-07ed-4701-9292-9e1d10c5766c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG nova.network.neutron [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating instance_info_cache with network_info: [{"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Releasing lock "refresh_cache-fe7578f8-07ed-4701-9292-9e1d10c5766c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'migration_context' on Instance uuid fe7578f8-07ed-4701-9292-9e1d10c5766c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG nova.objects.base [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Object Instance<fe7578f8-07ed-4701-9292-9e1d10c5766c> lazy-loaded attributes: info_cache,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:41:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:41:56 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:41:56 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:41:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.836s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:56 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Deleted allocation for migration 2b8791c8-dfc7-42a6-8bf5-b62fcff5a5d1
Oct 26 06:41:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6509120a-e6fd-48a2-b5ac-992b73f160f9 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.930s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:41:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:06 user nova-compute[74295]: INFO nova.compute.manager [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Terminating instance
Oct 26 06:42:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:42:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-7117ea90-7f93-464c-a790-a71e71276a5c req-193e8d6d-20b7-433d-9c33-d56e239113be service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received event network-vif-unplugged-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7117ea90-7f93-464c-a790-a71e71276a5c req-193e8d6d-20b7-433d-9c33-d56e239113be service nova] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7117ea90-7f93-464c-a790-a71e71276a5c req-193e8d6d-20b7-433d-9c33-d56e239113be service nova] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7117ea90-7f93-464c-a790-a71e71276a5c req-193e8d6d-20b7-433d-9c33-d56e239113be service nova] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-7117ea90-7f93-464c-a790-a71e71276a5c req-193e8d6d-20b7-433d-9c33-d56e239113be service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] No waiting events found dispatching network-vif-unplugged-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-7117ea90-7f93-464c-a790-a71e71276a5c req-193e8d6d-20b7-433d-9c33-d56e239113be service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received event network-vif-unplugged-fe72cf72-4a62-4633-9d46-a030363c03d8 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Instance destroyed successfully.
Oct 26 06:42:07 user nova-compute[74295]: DEBUG nova.objects.instance [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'resources' on Instance uuid f6d582e2-2c02-45b3-bac6-fb63c09c5344 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2010550983',display_name='tempest-AttachVolumeNegativeTest-server-2010550983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2010550983',id=30,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEskSwzoFqf4CJPYDTxtpxnDoXKwpEAwMd7moX6qjR9nrDBDUGx+jSmIVWbMqzCKOiStFVbgfuqeiWwGovKDRWx4lU3c7uqLJWZlBxmCy0onbKzHFUQ4KThYaO9vwtInKw==',key_name='tempest-keypair-1778652475',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-ufb15qnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:39:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=f6d582e2-2c02-45b3-bac6-fb63c09c5344,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "fe72cf72-4a62-4633-9d46-a030363c03d8", "address": "fa:16:3e:9c:3a:1f", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe72cf72-4a", "ovs_interfaceid": "fe72cf72-4a62-4633-9d46-a030363c03d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:3a:1f,bridge_name='br-int',has_traffic_filtering=True,id=fe72cf72-4a62-4633-9d46-a030363c03d8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe72cf72-4a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG os_vif [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:3a:1f,bridge_name='br-int',has_traffic_filtering=True,id=fe72cf72-4a62-4633-9d46-a030363c03d8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe72cf72-4a') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe72cf72-4a, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ed158da-3d5a-4eb8-9064-0f846e815bd5) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:42:07 user nova-compute[74295]: INFO os_vif [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:3a:1f,bridge_name='br-int',has_traffic_filtering=True,id=fe72cf72-4a62-4633-9d46-a030363c03d8,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe72cf72-4a')
Oct 26 06:42:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Deleting instance files /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344_del
Oct 26 06:42:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Deletion of /opt/stack/data/nova/instances/f6d582e2-2c02-45b3-bac6-fb63c09c5344_del complete
Oct 26 06:42:07 user nova-compute[74295]: INFO nova.compute.manager [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 06:42:07 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:42:07 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:42:08 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:42:08 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Took 0.82 seconds to deallocate network for instance.
Oct 26 06:42:08 user nova-compute[74295]: DEBUG nova.compute.manager [req-deab74b6-a3ea-4181-985b-9a4116e1dc0c req-5bd52826-47e9-4add-8d31-89a0dedfe63a service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received event network-vif-deleted-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:42:08 user nova-compute[74295]: INFO nova.compute.manager [req-deab74b6-a3ea-4181-985b-9a4116e1dc0c req-5bd52826-47e9-4add-8d31-89a0dedfe63a service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Neutron deleted interface fe72cf72-4a62-4633-9d46-a030363c03d8; detaching it from the instance and deleting it from the info cache
Oct 26 06:42:08 user nova-compute[74295]: DEBUG nova.network.neutron [req-deab74b6-a3ea-4181-985b-9a4116e1dc0c req-5bd52826-47e9-4add-8d31-89a0dedfe63a service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:42:08 user nova-compute[74295]: DEBUG nova.compute.manager [req-deab74b6-a3ea-4181-985b-9a4116e1dc0c req-5bd52826-47e9-4add-8d31-89a0dedfe63a service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Detach interface failed, port_id=fe72cf72-4a62-4633-9d46-a030363c03d8, reason: Instance f6d582e2-2c02-45b3-bac6-fb63c09c5344 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:42:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:08 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:42:08 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:42:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:08 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Deleted allocations for instance f6d582e2-2c02-45b3-bac6-fb63c09c5344
Oct 26 06:42:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7d4e192c-2c04-4e02-aa32-337565732c11 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.270s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-a9c8395c-db30-4c61-9406-3ae53515ac2b req-fcd7790d-68dc-4003-b38d-46c7aeeee42c service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received event network-vif-plugged-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:42:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a9c8395c-db30-4c61-9406-3ae53515ac2b req-fcd7790d-68dc-4003-b38d-46c7aeeee42c service nova] Acquiring lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a9c8395c-db30-4c61-9406-3ae53515ac2b req-fcd7790d-68dc-4003-b38d-46c7aeeee42c service nova] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a9c8395c-db30-4c61-9406-3ae53515ac2b req-fcd7790d-68dc-4003-b38d-46c7aeeee42c service nova] Lock "f6d582e2-2c02-45b3-bac6-fb63c09c5344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-a9c8395c-db30-4c61-9406-3ae53515ac2b req-fcd7790d-68dc-4003-b38d-46c7aeeee42c service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] No waiting events found dispatching network-vif-plugged-fe72cf72-4a62-4633-9d46-a030363c03d8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:42:09 user nova-compute[74295]: WARNING nova.compute.manager [req-a9c8395c-db30-4c61-9406-3ae53515ac2b req-fcd7790d-68dc-4003-b38d-46c7aeeee42c service nova] [instance: f6d582e2-2c02-45b3-bac6-fb63c09c5344] Received unexpected event network-vif-plugged-fe72cf72-4a62-4633-9d46-a030363c03d8 for instance with vm_state deleted and task_state None.
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:42:10 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Creating image(s)
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Ensure instance console log exists: /opt/stack/data/nova/instances/6988db00-49d1-44d4-b383-7c52a2c2faf7/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Start _get_guest_xml network_info=[{"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'b259ae11-87b7-40c8-96fb-126a21f76eb1', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBIPHfkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6988db00-49d1-44d4-b383-7c52a2c2faf7', 'attached_at': '', 'detached_at': '', 'volume_id': '9485718d-7de0-4c53-aaf1-3ea9bff6fcca', 'serial': '9485718d-7de0-4c53-aaf1-3ea9bff6fcca'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:42:10 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:42:10 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBIPHfkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:42:10 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:42:10 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:42:10 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3a284d-115e-44aa-8054-caf1e7a77398]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:42:10 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6765685-3b3c-41ef-b2e5-bfcb47534bbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca] added
Oct 26 06:42:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c229deb9-45a1-4c7d-ae73-7022cf24c36f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc05a5c-a0d6-484b-aebb-d97de84039fa]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mBIPHfkd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mBIPHfkd" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fbed27-f29b-4603-a78e-c5ce1b1e5a4e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mBIPHfkd'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f83750-cc13-47b0-89c5-5367e8757563]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5074873-66bb-4c3b-93d2-018db4c68777]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:10 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:10 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:10 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:10 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:10 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:42:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f4584d-a954-4887-a395-31cec8065bfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca, portal: 172.16.0.220,3260]
Oct 26 06:42:11 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca, portal: 172.16.0.220,3260] successful.
Oct 26 06:42:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10e5b29-8c55-4bd1-86c1-c3adb5c238b8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a73fc7-d6e4-498a-90b6-45802d09f73a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:11 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:11 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:11 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:42:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:11 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:11 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:11 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:42:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd93b47-2b00-42fc-bac7-675d3b185b01]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBIPHfkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'riTqLRbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:42:11 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:42:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23830313733343565', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830313733343565', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.372s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:42:12 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:42:12 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-178093482',display_name='tempest-TestVolumeBootPattern-server-178093482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-178093482',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-ubwgvmeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:41:34Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=6988db00-49d1-44d4-b383-7c52a2c2faf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:66:7a,bridge_name='br-int',has_traffic_filtering=True,id=62cc71c1-d718-453c-9df5-befb0c32e3ee,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cc71c1-d7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.objects.instance [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'pci_devices' on Instance uuid 6988db00-49d1-44d4-b383-7c52a2c2faf7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79e7228-9d18-4e3f-92c5-77f52e688bd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:42:12 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88ff6bb-0468-4107-8412-f6a144768111]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce] added
Oct 26 06:42:12 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:42:12 user nova-compute[74295]:   <uuid>6988db00-49d1-44d4-b383-7c52a2c2faf7</uuid>
Oct 26 06:42:12 user nova-compute[74295]:   <name>instance-00000020</name>
Oct 26 06:42:12 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:42:12 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:42:12 user nova-compute[74295]:   <metadata>
Oct 26 06:42:12 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:42:12 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:42:12 user nova-compute[74295]:       <nova:name>tempest-TestVolumeBootPattern-server-178093482</nova:name>
Oct 26 06:42:12 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:42:10</nova:creationTime>
Oct 26 06:42:12 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:42:12 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:42:12 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:42:12 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:42:12 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:42:12 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:42:12 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:42:12 user nova-compute[74295]:       <nova:owner>
Oct 26 06:42:12 user nova-compute[74295]:         <nova:user uuid="11f8c68bbe2245c6b6f159c45e006216">tempest-TestVolumeBootPattern-594294549-project-member</nova:user>
Oct 26 06:42:12 user nova-compute[74295]:         <nova:project uuid="75fe63ca1f244085963c38b864dff1db">tempest-TestVolumeBootPattern-594294549</nova:project>
Oct 26 06:42:12 user nova-compute[74295]:       </nova:owner>
Oct 26 06:42:12 user nova-compute[74295]:       <nova:ports>
Oct 26 06:42:12 user nova-compute[74295]:         <nova:port uuid="62cc71c1-d718-453c-9df5-befb0c32e3ee">
Oct 26 06:42:12 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 06:42:12 user nova-compute[74295]:         </nova:port>
Oct 26 06:42:12 user nova-compute[74295]:       </nova:ports>
Oct 26 06:42:12 user nova-compute[74295]:     </nova:instance>
Oct 26 06:42:12 user nova-compute[74295]:   </metadata>
Oct 26 06:42:12 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:42:12 user nova-compute[74295]:     <system>
Oct 26 06:42:12 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:42:12 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:42:12 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:42:12 user nova-compute[74295]:       <entry name="serial">6988db00-49d1-44d4-b383-7c52a2c2faf7</entry>
Oct 26 06:42:12 user nova-compute[74295]:       <entry name="uuid">6988db00-49d1-44d4-b383-7c52a2c2faf7</entry>
Oct 26 06:42:12 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:42:12 user nova-compute[74295]:     </system>
Oct 26 06:42:12 user nova-compute[74295]:   </sysinfo>
Oct 26 06:42:12 user nova-compute[74295]:   <os>
Oct 26 06:42:12 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:42:12 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:42:12 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:42:12 user nova-compute[74295]:   </os>
Oct 26 06:42:12 user nova-compute[74295]:   <features>
Oct 26 06:42:12 user nova-compute[74295]:     <acpi/>
Oct 26 06:42:12 user nova-compute[74295]:     <apic/>
Oct 26 06:42:12 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:42:12 user nova-compute[74295]:   </features>
Oct 26 06:42:12 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:42:12 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:42:12 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:42:12 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:42:12 user nova-compute[74295]:   </clock>
Oct 26 06:42:12 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:42:12 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:42:12 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:42:12 user nova-compute[74295]:   </cpu>
Oct 26 06:42:12 user nova-compute[74295]:   <devices>
Oct 26 06:42:12 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:42:12 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:42:12 user nova-compute[74295]:       <source dev="/dev/sdd"/>
Oct 26 06:42:12 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:42:12 user nova-compute[74295]:       <serial>9485718d-7de0-4c53-aaf1-3ea9bff6fcca</serial>
Oct 26 06:42:12 user nova-compute[74295]:     </disk>
Oct 26 06:42:12 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:42:12 user nova-compute[74295]:       <mac address="fa:16:3e:b2:66:7a"/>
Oct 26 06:42:12 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:42:12 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:42:12 user nova-compute[74295]:       <target dev="tap62cc71c1-d7"/>
Oct 26 06:42:12 user nova-compute[74295]:     </interface>
Oct 26 06:42:12 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:42:12 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/6988db00-49d1-44d4-b383-7c52a2c2faf7/console.log" append="off"/>
Oct 26 06:42:12 user nova-compute[74295]:     </serial>
Oct 26 06:42:12 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:42:12 user nova-compute[74295]:     <video>
Oct 26 06:42:12 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:42:12 user nova-compute[74295]:     </video>
Oct 26 06:42:12 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:42:12 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:42:12 user nova-compute[74295]:     </rng>
Oct 26 06:42:12 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:42:12 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:42:12 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:42:12 user nova-compute[74295]:     </memballoon>
Oct 26 06:42:12 user nova-compute[74295]:   </devices>
Oct 26 06:42:12 user nova-compute[74295]: </domain>
Oct 26 06:42:12 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-178093482',display_name='tempest-TestVolumeBootPattern-server-178093482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-178093482',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-ubwgvmeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:41:34Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=6988db00-49d1-44d4-b383-7c52a2c2faf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:66:7a,bridge_name='br-int',has_traffic_filtering=True,id=62cc71c1-d718-453c-9df5-befb0c32e3ee,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cc71c1-d7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_vif [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:66:7a,bridge_name='br-int',has_traffic_filtering=True,id=62cc71c1-d718-453c-9df5-befb0c32e3ee,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cc71c1-d7') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b0c18d7-52ea-578b-bcdd-be78720585f9', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62cc71c1-d7, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62cc71c1-d7, col_values=(('qos', UUID('38179a68-1471-43f9-8603-b5bcc3980f43')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62cc71c1-d7, col_values=(('external_ids', {'iface-id': '62cc71c1-d718-453c-9df5-befb0c32e3ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:66:7a', 'vm-uuid': '6988db00-49d1-44d4-b383-7c52a2c2faf7'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fd25b4-8710-4f2b-9a2c-0481bf4d5d25]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:12 user nova-compute[74295]: INFO os_vif [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:66:7a,bridge_name='br-int',has_traffic_filtering=True,id=62cc71c1-d718-453c-9df5-befb0c32e3ee,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cc71c1-d7')
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48ed7f4-5f2b-4959-b163-a919d607ea00]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v riTqLRbo {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v riTqLRbo" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1b6a85-d75b-455f-8521-6ffe9734b578]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'riTqLRbo'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No VIF found with MAC fa:16:3e:b2:66:7a, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[799e5517-171a-4617-9928-1ea0a3e98257]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[878e196d-3b06-402c-83fc-703ec3055ab6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:42:12 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:42:12 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa6ed32-c0dc-4257-95dc-a92bc4196495]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce, portal: 172.16.0.220,3260]
Oct 26 06:42:12 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce, portal: 172.16.0.220,3260] successful.
Oct 26 06:42:12 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[73094367-caa0-4bdd-bc2c-85d27d379fb7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c4ed09-f104-492b-a1fd-54f8234fef60]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce (non-flash)
Oct 26 06:42:12 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:42:12 user nova-compute[74295]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce (non-flash)
Oct 26 06:42:12 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e6aba6-ef9d-4077-ac8a-eac1701148d5]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:42:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'riTqLRbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] <== connect_volume: return (1704ms) {'type': 'block', 'scsi_wwn': '23863626639333661', 'path': '/dev/sdf'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863626639333661', 'path': '/dev/sdf'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG nova.objects.instance [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'flavor' on Instance uuid 02d21159-fa28-4df3-b40b-031765d424c2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:42:13 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:42:13 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:42:13 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:42:13 user nova-compute[74295]:   <serial>b733717f-d1e2-441b-b5bf-44ec214b8cce</serial>
Oct 26 06:42:13 user nova-compute[74295]: </disk>
Oct 26 06:42:13 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-5ca987c4-2158-4247-bf2f-8a9ba827004b req-9b501904-9a58-441d-9716-0f6aa2f3c273 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received event network-vif-plugged-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5ca987c4-2158-4247-bf2f-8a9ba827004b req-9b501904-9a58-441d-9716-0f6aa2f3c273 service nova] Acquiring lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5ca987c4-2158-4247-bf2f-8a9ba827004b req-9b501904-9a58-441d-9716-0f6aa2f3c273 service nova] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5ca987c4-2158-4247-bf2f-8a9ba827004b req-9b501904-9a58-441d-9716-0f6aa2f3c273 service nova] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-5ca987c4-2158-4247-bf2f-8a9ba827004b req-9b501904-9a58-441d-9716-0f6aa2f3c273 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] No waiting events found dispatching network-vif-plugged-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:42:13 user nova-compute[74295]: WARNING nova.compute.manager [req-5ca987c4-2158-4247-bf2f-8a9ba827004b req-9b501904-9a58-441d-9716-0f6aa2f3c273 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received unexpected event network-vif-plugged-62cc71c1-d718-453c-9df5-befb0c32e3ee for instance with vm_state building and task_state spawning.
Oct 26 06:42:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] No VIF found with MAC fa:16:3e:92:4a:ba, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d936945a-6d08-4a89-9ef9-4347f1ad1c9f tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.566s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 06:42:14 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-3071e6da-5cac-4907-83f3-f5f6f02cbc5d req-90cd6450-caba-4bca-8f00-0cc1460b5769 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received event network-vif-plugged-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3071e6da-5cac-4907-83f3-f5f6f02cbc5d req-90cd6450-caba-4bca-8f00-0cc1460b5769 service nova] Acquiring lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3071e6da-5cac-4907-83f3-f5f6f02cbc5d req-90cd6450-caba-4bca-8f00-0cc1460b5769 service nova] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3071e6da-5cac-4907-83f3-f5f6f02cbc5d req-90cd6450-caba-4bca-8f00-0cc1460b5769 service nova] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-3071e6da-5cac-4907-83f3-f5f6f02cbc5d req-90cd6450-caba-4bca-8f00-0cc1460b5769 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] No waiting events found dispatching network-vif-plugged-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:42:15 user nova-compute[74295]: WARNING nova.compute.manager [req-3071e6da-5cac-4907-83f3-f5f6f02cbc5d req-90cd6450-caba-4bca-8f00-0cc1460b5769 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received unexpected event network-vif-plugged-62cc71c1-d718-453c-9df5-befb0c32e3ee for instance with vm_state building and task_state spawning.
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updating instance_info_cache with network_info: [{"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-9f9f523a-896e-414d-a24e-ba2c6b6a9834" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:42:16 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Instance spawned successfully.
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:42:16 user nova-compute[74295]: INFO nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:16 user nova-compute[74295]: INFO nova.compute.manager [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Detaching volume b733717f-d1e2-441b-b5bf-44ec214b8cce
Oct 26 06:42:16 user nova-compute[74295]: INFO nova.compute.manager [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Took 43.10 seconds to build instance.
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-be91476e-b003-4c88-87e3-92ea4062ea63 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.208s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:16 user nova-compute[74295]: INFO nova.compute.manager [None req-c7111742-51f1-40d1-b462-3807f9058b5c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Unrescuing
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c7111742-51f1-40d1-b462-3807f9058b5c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c7111742-51f1-40d1-b462-3807f9058b5c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquired lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c7111742-51f1-40d1-b462-3807f9058b5c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:42:16 user nova-compute[74295]: INFO nova.virt.block_device [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Attempting to driver detach volume b733717f-d1e2-441b-b5bf-44ec214b8cce from mountpoint /dev/vdb
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Attempting to detach device vdb from instance 02d21159-fa28-4df3-b40b-031765d424c2 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:42:16 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:42:16 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:42:16 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:42:16 user nova-compute[74295]:   <serial>b733717f-d1e2-441b-b5bf-44ec214b8cce</serial>
Oct 26 06:42:16 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:42:16 user nova-compute[74295]: </disk>
Oct 26 06:42:16 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:42:16 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Successfully detached device vdb from instance 02d21159-fa28-4df3-b40b-031765d424c2 from the persistent domain config.
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02d21159-fa28-4df3-b40b-031765d424c2 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:42:16 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:42:16 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:42:16 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:42:16 user nova-compute[74295]:   <serial>b733717f-d1e2-441b-b5bf-44ec214b8cce</serial>
Oct 26 06:42:16 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:42:16 user nova-compute[74295]: </disk>
Oct 26 06:42:16 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c7111742-51f1-40d1-b462-3807f9058b5c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Updating instance_info_cache with network_info: [{"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c7111742-51f1-40d1-b462-3807f9058b5c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Releasing lock "refresh_cache-29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c7111742-51f1-40d1-b462-3807f9058b5c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'flavor' on Instance uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02d21159-fa28-4df3-b40b-031765d424c2 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-e38a434b-e218-4d59-87a8-cc344e83c067 req-20e30273-9584-49e3-b356-be727fe56ee6 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-unplugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e38a434b-e218-4d59-87a8-cc344e83c067 req-20e30273-9584-49e3-b356-be727fe56ee6 service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e38a434b-e218-4d59-87a8-cc344e83c067 req-20e30273-9584-49e3-b356-be727fe56ee6 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e38a434b-e218-4d59-87a8-cc344e83c067 req-20e30273-9584-49e3-b356-be727fe56ee6 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-e38a434b-e218-4d59-87a8-cc344e83c067 req-20e30273-9584-49e3-b356-be727fe56ee6 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-unplugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:42:17 user nova-compute[74295]: WARNING nova.compute.manager [req-e38a434b-e218-4d59-87a8-cc344e83c067 req-20e30273-9584-49e3-b356-be727fe56ee6 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-unplugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:42:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:17 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Instance destroyed successfully.
Oct 26 06:42:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:42:19 user nova-compute[74295]: WARNING nova.compute.manager [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:42:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:42:19 user nova-compute[74295]: WARNING nova.compute.manager [req-a800df8a-29f8-426d-936a-a611be228fd8 req-d96253b7-312d-413f-aad3-1f4b74398eef service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c7111742-51f1-40d1-b462-3807f9058b5c tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-4eaef0d4-6ac6-420f-b34e-f67f1012f707 req-17757e30-88ae-4477-9c65-7c0070466f0e service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4eaef0d4-6ac6-420f-b34e-f67f1012f707 req-17757e30-88ae-4477-9c65-7c0070466f0e service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4eaef0d4-6ac6-420f-b34e-f67f1012f707 req-17757e30-88ae-4477-9c65-7c0070466f0e service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4eaef0d4-6ac6-420f-b34e-f67f1012f707 req-17757e30-88ae-4477-9c65-7c0070466f0e service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-4eaef0d4-6ac6-420f-b34e-f67f1012f707 req-17757e30-88ae-4477-9c65-7c0070466f0e service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:42:21 user nova-compute[74295]: WARNING nova.compute.manager [req-4eaef0d4-6ac6-420f-b34e-f67f1012f707 req-17757e30-88ae-4477-9c65-7c0070466f0e service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state active and task_state None.
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:42:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:42:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:42:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:42:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7361MB free_disk=24.898025512695312GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:42:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fb03897e-7f9e-497a-b703-ca862b11672f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1ec0a113-9297-4a51-90fc-83951205185e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 02d21159-fa28-4df3-b40b-031765d424c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fe7578f8-07ed-4701-9292-9e1d10c5766c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 6988db00-49d1-44d4-b383-7c52a2c2faf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 06:42:24 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG nova.objects.instance [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'flavor' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:42:32 user nova-compute[74295]: INFO nova.compute.manager [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Attaching volume fb3a1533-688b-43ec-be06-8de3836fbf2b to /dev/vdb
Oct 26 06:42:32 user nova-compute[74295]: DEBUG os_brick.utils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e6080c-8a6b-4d20-b4aa-93e7eaf403f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89cb850-5b34-473d-8f22-3df477bf0854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3bf164-a332-4b9d-95ef-a67bcae305a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3808f6df-df6b-4440-88dd-ac54bd9f6a41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:42:32 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:42:32 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf425d26-2e12-4f90-bcfe-e6f7df698882]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG os_brick.utils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:42:32 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating existing volume attachment record: 7ade0320-8711-4c98-af89-e9cd2dd99fa3 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:42:36 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02d21159-fa28-4df3-b40b-031765d424c2 is timed out.
Oct 26 06:42:36 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Successfully detached device vdb from instance 02d21159-fa28-4df3-b40b-031765d424c2 from the live domain config.
Oct 26 06:42:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:42:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'riTqLRbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:42:36 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:42:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:42:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:42:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b180ab81-7132-46c4-a379-543a8e797a64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:42:36 user nova-compute[74295]: No targets found.
Oct 26 06:42:36 user nova-compute[74295]: iSNS:
Oct 26 06:42:36 user nova-compute[74295]: No targets found.
Oct 26 06:42:36 user nova-compute[74295]: STATIC:
Oct 26 06:42:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca
Oct 26 06:42:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:42:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:42:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3
Oct 26 06:42:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:42:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:42:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:42:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:42:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:42:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce
Oct 26 06:42:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:42:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:42:36 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:42:36 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:42:36 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:42:36 user nova-compute[74295]: FIRMWARE:
Oct 26 06:42:36 user nova-compute[74295]: No targets found.
Oct 26 06:42:36 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:42:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:42:36 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:42:36 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:42:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:42:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d197276b-ace4-4707-b33c-78a4268e4272]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b0dafc-6fa8-411f-ad76-95fc07131753]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:37 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:37 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:37 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:42:37 user nova-compute[74295]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce (non-flash)
Oct 26 06:42:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:42:37 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:42:37 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:42:37 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:42:37 user nova-compute[74295]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce (non-flash)
Oct 26 06:42:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac658b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce'): ({'sdf'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Removing single pathed devices sdf {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d690f1-b422-401a-b7f1-49e152d27884]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f95af99-7987-4dc4-bf4b-99bbd0695676]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Flushing IO for device /dev/sdf {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2565d4cc-1de5-4991-9689-7f200dca4708]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bc8fee-cc93-438e-9bb0-6e31cc9cfabc]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3eb84e-6c3d-4196-980c-648e615fd85f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3203b6b3-a72f-456d-b7b5-e3456a17fa09]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce, portal: 172.16.0.220,3260]
Oct 26 06:42:37 user nova-compute[74295]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce, portal: 172.16.0.220,3260] successful.
Oct 26 06:42:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b733717f-d1e2-441b-b5bf-44ec214b8cce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a23d613-c2c0-46a3-af1a-65d6cf30b48c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] <== disconnect_volume: return (334ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:42:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:51 user nova-compute[74295]: DEBUG nova.objects.instance [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'flavor' on Instance uuid 02d21159-fa28-4df3-b40b-031765d424c2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:42:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-87a94751-7086-4c23-9fc6-9fe7ecff430e tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.550s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:42:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:42:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:43:00 user nova-compute[74295]: INFO nova.compute.claims [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Claim successful on node user
Oct 26 06:43:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 06:43:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:43:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NQjZuhbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:43:01 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:43:01 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:43:01 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.policy [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a23e0e206f504aaeb7909b322ea2d563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c9296eef7f4c45b5275803942de414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc33f27-49ab-4148-869c-26b51af3f7c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:43:01 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce2892-13b3-4664-8950-817e62d779bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b] added
Oct 26 06:43:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeba65e-d2c4-4015-96cf-100b9a35d36b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:43:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Creating image(s)
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "/opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "/opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f044c7-c069-42aa-9648-7b14de9cb8c7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NQjZuhbL {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NQjZuhbL" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d386740b-0b55-4d24-8d14-0001129e2db6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NQjZuhbL'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a6b6ac-f4c4-42ff-9ffd-3fb5d1ef11af]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[17478c72-4712-43d8-87e7-038e2e6edac9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:43:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:43:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.191s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af51324-7c42-47cf-92f3-f3d328e2b259]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b, portal: 172.16.0.220,3260]
Oct 26 06:43:01 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b, portal: 172.16.0.220,3260] successful.
Oct 26 06:43:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d9a393-f040-4f75-b236-0df8d1115f77]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb10c748-f50a-4dc8-bdf0-8582cd67a9d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:43:01 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9057a8-5669-4008-a67c-85b3a6da3e09]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NQjZuhbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk 1073741824" returned: 0 in 0.052s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.189s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Cannot resize image /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Ensure instance console log exists: /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Successfully created port: 5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '26461646464336234', 'path': '/dev/sdf'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461646464336234', 'path': '/dev/sdf'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG nova.objects.instance [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'flavor' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:43:02 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:43:02 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:43:02 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:43:02 user nova-compute[74295]:   <serial>fb3a1533-688b-43ec-be06-8de3836fbf2b</serial>
Oct 26 06:43:02 user nova-compute[74295]: </disk>
Oct 26 06:43:02 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Successfully updated port: 5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "refresh_cache-2a48ac34-3913-482f-91bd-7158c5b1f2bb" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquired lock "refresh_cache-2a48ac34-3913-482f-91bd-7158c5b1f2bb" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-06577668-f08a-4f8d-87bb-192b24393954 req-6c7070ab-94c0-48c7-a22c-b4203afa15b0 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received event network-changed-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-06577668-f08a-4f8d-87bb-192b24393954 req-6c7070ab-94c0-48c7-a22c-b4203afa15b0 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Refreshing instance network info cache due to event network-changed-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-06577668-f08a-4f8d-87bb-192b24393954 req-6c7070ab-94c0-48c7-a22c-b4203afa15b0 service nova] Acquiring lock "refresh_cache-2a48ac34-3913-482f-91bd-7158c5b1f2bb" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] No VIF found with MAC fa:16:3e:dd:71:e8, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Updating instance_info_cache with network_info: [{"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Releasing lock "refresh_cache-2a48ac34-3913-482f-91bd-7158c5b1f2bb" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Instance network_info: |[{"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ec07799a-f347-49bf-b3dc-ef228765fe74 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.909s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-06577668-f08a-4f8d-87bb-192b24393954 req-6c7070ab-94c0-48c7-a22c-b4203afa15b0 service nova] Acquired lock "refresh_cache-2a48ac34-3913-482f-91bd-7158c5b1f2bb" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-06577668-f08a-4f8d-87bb-192b24393954 req-6c7070ab-94c0-48c7-a22c-b4203afa15b0 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Refreshing network info cache for port 5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Start _get_guest_xml network_info=[{"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:43:03 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:43:03 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-574978432',display_name='tempest-AttachVolumeNegativeTest-server-574978432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-574978432',id=34,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUoZDo6STXbe2dWMhaBeTAZR8XpesCXDGazRS3tjgFmHA9Lcs+r5pFxlCyxYcXea/vK56zP+A9axG3ciyT6s71K5VOj0LToo8CmxgZqV663XlF5KeaFHsfTQ7rSVrL9nQ==',key_name='tempest-keypair-2072277416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-qhqmdj57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=2a48ac34-3913-482f-91bd-7158c5b1f2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:41:2e,bridge_name='br-int',has_traffic_filtering=True,id=5d60b5a7-6e0d-466e-9bf9-7c686ad4c241,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d60b5a7-6e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a48ac34-3913-482f-91bd-7158c5b1f2bb {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:43:03 user nova-compute[74295]:   <uuid>2a48ac34-3913-482f-91bd-7158c5b1f2bb</uuid>
Oct 26 06:43:03 user nova-compute[74295]:   <name>instance-00000022</name>
Oct 26 06:43:03 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:43:03 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:43:03 user nova-compute[74295]:   <metadata>
Oct 26 06:43:03 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:43:03 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:43:03 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeNegativeTest-server-574978432</nova:name>
Oct 26 06:43:03 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:43:03</nova:creationTime>
Oct 26 06:43:03 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:43:03 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:43:03 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:43:03 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:43:03 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:43:03 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:43:03 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:43:03 user nova-compute[74295]:       <nova:owner>
Oct 26 06:43:03 user nova-compute[74295]:         <nova:user uuid="a23e0e206f504aaeb7909b322ea2d563">tempest-AttachVolumeNegativeTest-1112300090-project-member</nova:user>
Oct 26 06:43:03 user nova-compute[74295]:         <nova:project uuid="c2c9296eef7f4c45b5275803942de414">tempest-AttachVolumeNegativeTest-1112300090</nova:project>
Oct 26 06:43:03 user nova-compute[74295]:       </nova:owner>
Oct 26 06:43:03 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:43:03 user nova-compute[74295]:       <nova:ports>
Oct 26 06:43:03 user nova-compute[74295]:         <nova:port uuid="5d60b5a7-6e0d-466e-9bf9-7c686ad4c241">
Oct 26 06:43:03 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 06:43:03 user nova-compute[74295]:         </nova:port>
Oct 26 06:43:03 user nova-compute[74295]:       </nova:ports>
Oct 26 06:43:03 user nova-compute[74295]:     </nova:instance>
Oct 26 06:43:03 user nova-compute[74295]:   </metadata>
Oct 26 06:43:03 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:43:03 user nova-compute[74295]:     <system>
Oct 26 06:43:03 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:43:03 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:43:03 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:43:03 user nova-compute[74295]:       <entry name="serial">2a48ac34-3913-482f-91bd-7158c5b1f2bb</entry>
Oct 26 06:43:03 user nova-compute[74295]:       <entry name="uuid">2a48ac34-3913-482f-91bd-7158c5b1f2bb</entry>
Oct 26 06:43:03 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:43:03 user nova-compute[74295]:     </system>
Oct 26 06:43:03 user nova-compute[74295]:   </sysinfo>
Oct 26 06:43:03 user nova-compute[74295]:   <os>
Oct 26 06:43:03 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:43:03 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:43:03 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:43:03 user nova-compute[74295]:   </os>
Oct 26 06:43:03 user nova-compute[74295]:   <features>
Oct 26 06:43:03 user nova-compute[74295]:     <acpi/>
Oct 26 06:43:03 user nova-compute[74295]:     <apic/>
Oct 26 06:43:03 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:43:03 user nova-compute[74295]:   </features>
Oct 26 06:43:03 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:43:03 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:43:03 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:43:03 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:43:03 user nova-compute[74295]:   </clock>
Oct 26 06:43:03 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:43:03 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:43:03 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:43:03 user nova-compute[74295]:   </cpu>
Oct 26 06:43:03 user nova-compute[74295]:   <devices>
Oct 26 06:43:03 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:43:03 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:43:03 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk"/>
Oct 26 06:43:03 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:43:03 user nova-compute[74295]:     </disk>
Oct 26 06:43:03 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:43:03 user nova-compute[74295]:       <mac address="fa:16:3e:77:41:2e"/>
Oct 26 06:43:03 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:43:03 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:43:03 user nova-compute[74295]:       <target dev="tap5d60b5a7-6e"/>
Oct 26 06:43:03 user nova-compute[74295]:     </interface>
Oct 26 06:43:03 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:43:03 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/console.log" append="off"/>
Oct 26 06:43:03 user nova-compute[74295]:     </serial>
Oct 26 06:43:03 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:43:03 user nova-compute[74295]:     <video>
Oct 26 06:43:03 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:43:03 user nova-compute[74295]:     </video>
Oct 26 06:43:03 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:43:03 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:43:03 user nova-compute[74295]:     </rng>
Oct 26 06:43:03 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:43:03 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:43:03 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:43:03 user nova-compute[74295]:     </memballoon>
Oct 26 06:43:03 user nova-compute[74295]:   </devices>
Oct 26 06:43:03 user nova-compute[74295]: </domain>
Oct 26 06:43:03 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-574978432',display_name='tempest-AttachVolumeNegativeTest-server-574978432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-574978432',id=34,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUoZDo6STXbe2dWMhaBeTAZR8XpesCXDGazRS3tjgFmHA9Lcs+r5pFxlCyxYcXea/vK56zP+A9axG3ciyT6s71K5VOj0LToo8CmxgZqV663XlF5KeaFHsfTQ7rSVrL9nQ==',key_name='tempest-keypair-2072277416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-qhqmdj57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=2a48ac34-3913-482f-91bd-7158c5b1f2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:41:2e,bridge_name='br-int',has_traffic_filtering=True,id=5d60b5a7-6e0d-466e-9bf9-7c686ad4c241,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d60b5a7-6e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG os_vif [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:41:2e,bridge_name='br-int',has_traffic_filtering=True,id=5d60b5a7-6e0d-466e-9bf9-7c686ad4c241,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d60b5a7-6e') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d8a3d3d-2928-5004-ad6c-880ca9290a84', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d60b5a7-6e, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d60b5a7-6e, col_values=(('qos', UUID('65609dac-bcda-42e3-851a-d146ef3c10c7')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d60b5a7-6e, col_values=(('external_ids', {'iface-id': '5d60b5a7-6e0d-466e-9bf9-7c686ad4c241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:41:2e', 'vm-uuid': '2a48ac34-3913-482f-91bd-7158c5b1f2bb'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:03 user nova-compute[74295]: INFO os_vif [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:41:2e,bridge_name='br-int',has_traffic_filtering=True,id=5d60b5a7-6e0d-466e-9bf9-7c686ad4c241,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d60b5a7-6e')
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No VIF found with MAC fa:16:3e:77:41:2e, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-06577668-f08a-4f8d-87bb-192b24393954 req-6c7070ab-94c0-48c7-a22c-b4203afa15b0 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Updated VIF entry in instance network info cache for port 5d60b5a7-6e0d-466e-9bf9-7c686ad4c241. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-06577668-f08a-4f8d-87bb-192b24393954 req-6c7070ab-94c0-48c7-a22c-b4203afa15b0 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Updating instance_info_cache with network_info: [{"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-06577668-f08a-4f8d-87bb-192b24393954 req-6c7070ab-94c0-48c7-a22c-b4203afa15b0 service nova] Releasing lock "refresh_cache-2a48ac34-3913-482f-91bd-7158c5b1f2bb" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:05 user nova-compute[74295]: INFO nova.compute.manager [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Rescuing
Oct 26 06:43:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquired lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-08e7f9f7-effb-4197-b22d-b95cd7db1d75 req-5234cf97-aa3d-48e2-a822-25e511006cc3 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received event network-vif-plugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-08e7f9f7-effb-4197-b22d-b95cd7db1d75 req-5234cf97-aa3d-48e2-a822-25e511006cc3 service nova] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-08e7f9f7-effb-4197-b22d-b95cd7db1d75 req-5234cf97-aa3d-48e2-a822-25e511006cc3 service nova] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-08e7f9f7-effb-4197-b22d-b95cd7db1d75 req-5234cf97-aa3d-48e2-a822-25e511006cc3 service nova] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-08e7f9f7-effb-4197-b22d-b95cd7db1d75 req-5234cf97-aa3d-48e2-a822-25e511006cc3 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] No waiting events found dispatching network-vif-plugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:05 user nova-compute[74295]: WARNING nova.compute.manager [req-08e7f9f7-effb-4197-b22d-b95cd7db1d75 req-5234cf97-aa3d-48e2-a822-25e511006cc3 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received unexpected event network-vif-plugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 for instance with vm_state building and task_state spawning.
Oct 26 06:43:05 user nova-compute[74295]: DEBUG nova.network.neutron [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Releasing lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Instance destroyed successfully.
Oct 26 06:43:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Attempting a stable device rescue
Oct 26 06:43:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74295) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 06:43:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Instance directory exists: not creating {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 06:43:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Creating image(s)
Oct 26 06:43:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:06 user nova-compute[74295]: DEBUG nova.objects.instance [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "85a0f8e5c6310c39f76232f8d91e5918c6f4276a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "85a0f8e5c6310c39f76232f8d91e5918c6f4276a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received event network-vif-plugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] No waiting events found dispatching network-vif-plugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:07 user nova-compute[74295]: WARNING nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received unexpected event network-vif-plugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 for instance with vm_state building and task_state spawning.
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-unplugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-unplugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:07 user nova-compute[74295]: WARNING nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-unplugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state active and task_state rescuing.
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:07 user nova-compute[74295]: WARNING nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state active and task_state rescuing.
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received event network-changed-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Refreshing instance network info cache due to event network-changed-7e4de530-6d56-4e35-a1b7-cbb3746ede9d. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Acquiring lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Acquired lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.network.neutron [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Refreshing network info cache for port 7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:07 user nova-compute[74295]: INFO nova.compute.manager [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Terminating instance
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:43:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Instance spawned successfully.
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a.part --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.virt.images [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] 273533c0-f58d-4726-95bc-96e0f6b74b32 was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a.part /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:43:08 user nova-compute[74295]: INFO nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Took 6.77 seconds to spawn the instance on the hypervisor.
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: INFO nova.compute.manager [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Took 8.07 seconds to build instance.
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.network.neutron [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Updated VIF entry in instance network info cache for port 7e4de530-6d56-4e35-a1b7-cbb3746ede9d. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.network.neutron [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Updating instance_info_cache with network_info: [{"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e3fdf1ff-8e42-4919-93c2-1ffa035ee055 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.243s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0620854b-3e19-437d-be2c-8644050317ef req-e10267d0-6995-43c7-98d8-adbe214b82fc service nova] Releasing lock "refresh_cache-02d21159-fa28-4df3-b40b-031765d424c2" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a.part /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a.converted" returned: 0 in 0.626s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Instance destroyed successfully.
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.objects.instance [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'resources' on Instance uuid 02d21159-fa28-4df3-b40b-031765d424c2 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2083745609',display_name='tempest-TestStampPattern-server-2083745609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2083745609',id=31,image_ref='d2564feb-386e-4011-88c2-94e0d29c8c1a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEAdKcn8BfIKAadtFceMe64jXIA47ijBG6BK3Cx0+eFXmVCy7VFEkebqDvzRsQ0zTl6IjK9Qm73ynWPZigB9lmyvdFYYVp4BU04c1HSaUw88rA3kLK5vGAV3HV0ee2Bw==',key_name='tempest-TestStampPattern-1605295167',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:39:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8af562736824561a4f55f68f27a0b85',ramdisk_id='',reservation_id='r-m00do7f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fb03897e-7f9e-497a-b703-ca862b11672f',image_min_disk='1',image_min_ram='0',image_owner_id='d8af562736824561a4f55f68f27a0b85',image_owner_project_name='tempest-TestStampPattern-91727882',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-91727882-project-member',image_user_id='5f6d23275c654de1926a7cb988451d10',owner_project_name='tempest-TestStampPattern-91727882',owner_user_name='tempest-TestStampPattern-91727882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:39:55Z,user_data=None,user_id='5f6d23275c654de1926a7cb988451d10',uuid=02d21159-fa28-4df3-b40b-031765d424c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converting VIF {"id": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "address": "fa:16:3e:92:4a:ba", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4de530-6d", "ovs_interfaceid": "7e4de530-6d56-4e35-a1b7-cbb3746ede9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:4a:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e4de530-6d56-4e35-a1b7-cbb3746ede9d,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4de530-6d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG os_vif [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:4a:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e4de530-6d56-4e35-a1b7-cbb3746ede9d,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4de530-6d') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e4de530-6d, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e219cac-e866-4c24-adf9-eca4b67a8c38) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:08 user nova-compute[74295]: INFO os_vif [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:4a:ba,bridge_name='br-int',has_traffic_filtering=True,id=7e4de530-6d56-4e35-a1b7-cbb3746ede9d,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4de530-6d')
Oct 26 06:43:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Deleting instance files /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2_del
Oct 26 06:43:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Deletion of /opt/stack/data/nova/instances/02d21159-fa28-4df3-b40b-031765d424c2_del complete
Oct 26 06:43:08 user nova-compute[74295]: INFO nova.compute.manager [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "85a0f8e5c6310c39f76232f8d91e5918c6f4276a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.253s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "85a0f8e5c6310c39f76232f8d91e5918c6f4276a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "85a0f8e5c6310c39f76232f8d91e5918c6f4276a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a,backing_fmt=raw /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a,backing_fmt=raw /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue" returned: 0 in 0.052s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "85a0f8e5c6310c39f76232f8d91e5918c6f4276a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.instance [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'migration_context' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Object Instance<1ec0a113-9297-4a51-90fc-83951205185e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Start _get_guest_xml network_info=[{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "vif_mac": "fa:16:3e:dd:71:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '273533c0-f58d-4726-95bc-96e0f6b74b32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '7ade0320-8711-4c98-af89-e9cd2dd99fa3', 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NQjZuhbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '1ec0a113-9297-4a51-90fc-83951205185e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb3a1533-688b-43ec-be06-8de3836fbf2b', 'serial': 'fb3a1533-688b-43ec-be06-8de3836fbf2b'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.instance [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'resources' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Object Instance<1ec0a113-9297-4a51-90fc-83951205185e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.instance [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'numa_topology' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Object Instance<1ec0a113-9297-4a51-90fc-83951205185e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:43:09 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:43:09 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.instance [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Object Instance<1ec0a113-9297-4a51-90fc-83951205185e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NQjZuhbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:43:09 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:43:09 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:43:09 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cff334-b5f5-4539-8fb5-b53d2d0e96f2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NQjZuhbL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 06:43:09 user nova-compute[74295]: node.name = iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b
Oct 26 06:43:09 user nova-compute[74295]: node.tpgt = -1
Oct 26 06:43:09 user nova-compute[74295]: node.startup = automatic
Oct 26 06:43:09 user nova-compute[74295]: node.leading_login = No
Oct 26 06:43:09 user nova-compute[74295]: iface.iscsi_ifacename = default
Oct 26 06:43:09 user nova-compute[74295]: iface.net_ifacename = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.ipaddress = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.prefix_len = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.hwaddress = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.transport_name = tcp
Oct 26 06:43:09 user nova-compute[74295]: iface.initiatorname = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.state = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.vlan_id = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.vlan_priority = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.vlan_state = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.iface_num = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.mtu = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.port = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.bootproto = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.subnet_mask = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.gateway = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.dhcp_alt_client_id = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.dhcp_dns = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.dhcp_learn_iqn = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.dhcp_vendor_id_state = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.dhcp_vendor_id = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.dhcp_slp_da = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.fragmentation = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.gratuitous_arp = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.incoming_forwarding = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.tos_state = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.tos = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.ttl = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.delayed_ack = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.tcp_nagle = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.tcp_wsf_state = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.tcp_wsf = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.tcp_timer_scale = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.tcp_timestamp = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.redirect = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.def_task_mgmt_timeout = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.header_digest = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.data_digest = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.immediate_data = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.initial_r2t = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.data_seq_inorder = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.data_pdu_inorder = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.erl = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.max_receive_data_len = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.first_burst_len = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.max_outstanding_r2t = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.max_burst_len = 0
Oct 26 06:43:09 user nova-compute[74295]: iface.chap_auth = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.bidi_chap = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.strict_login_compliance = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.discovery_auth = <empty>
Oct 26 06:43:09 user nova-compute[74295]: iface.discovery_logout = <empty>
Oct 26 06:43:09 user nova-compute[74295]: node.discovery_address = <empty>
Oct 26 06:43:09 user nova-compute[74295]: node.discovery_port = 0
Oct 26 06:43:09 user nova-compute[74295]: node.discovery_type = static
Oct 26 06:43:09 user nova-compute[74295]: node.session.initial_cmdsn = 0
Oct 26 06:43:09 user nova-compute[74295]: node.session.initial_login_retry_max = 8
Oct 26 06:43:09 user nova-compute[74295]: node.session.xmit_thread_priority = -20
Oct 26 06:43:09 user nova-compute[74295]: node.session.cmds_max = 128
Oct 26 06:43:09 user nova-compute[74295]: node.session.queue_depth = 32
Oct 26 06:43:09 user nova-compute[74295]: node.session.nr_sessions = 1
Oct 26 06:43:09 user nova-compute[74295]: node.session.auth.authmethod = CHAP
Oct 26 06:43:09 user nova-compute[74295]: node.session.auth.username = NQjZuhbL
Oct 26 06:43:09 user nova-compute[74295]: node.session.auth.password = ***
Oct 26 06:43:09 user nova-compute[74295]: node.session.auth.username_in = <empty>
Oct 26 06:43:09 user nova-compute[74295]: node.session.auth.password_in = <empty>
Oct 26 06:43:09 user nova-compute[74295]: node.session.auth.chap_algs = MD5
Oct 26 06:43:09 user nova-compute[74295]: node.session.timeo.replacement_timeout = 120
Oct 26 06:43:09 user nova-compute[74295]: node.session.err_timeo.abort_timeout = 15
Oct 26 06:43:09 user nova-compute[74295]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 06:43:09 user nova-compute[74295]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 06:43:09 user nova-compute[74295]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.FastAbort = Yes
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.InitialR2T = No
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.ImmediateData = Yes
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.MaxConnections = 1
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 06:43:09 user nova-compute[74295]: node.session.iscsi.ERL = 0
Oct 26 06:43:09 user nova-compute[74295]: node.session.scan = manual
Oct 26 06:43:09 user nova-compute[74295]: node.session.reopen_max = 0
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].address = 172.16.0.220
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].port = 3260
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].startup = manual
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].tcp.window_size = 524288
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].tcp.type_of_service = 0
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].timeo.logout_timeout = 15
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].timeo.login_timeout = 15
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].timeo.auth_timeout = 45
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].iscsi.DataDigest = None
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].iscsi.IFMarker = No
Oct 26 06:43:09 user nova-compute[74295]: node.conn[0].iscsi.OFMarker = No
Oct 26 06:43:09 user nova-compute[74295]: # END RECORD
Oct 26 06:43:09 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa760ee-1e82-4169-96b7-8205960e8a95]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:09 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Took 0.52 seconds to deallocate network for instance.
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a95471-58cd-4bca-bd1d-3d19a2656bee]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NQjZuhbL {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-736a612f-122d-4455-afe3-a86daaf021cb req-7d83d999-a576-46e5-9efc-05862cf77d82 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received event network-vif-deleted-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NQjZuhbL" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3a78b7-ebb0-4fa3-8bed-c764eb8a77fa]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NQjZuhbL'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefe7ff7-eafe-4424-a101-02ef85715942]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[808e4220-0ad5-4d62-9f01-43e2362d0775]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:09 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:09 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:09 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:43:09 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:09 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:09 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:09 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:09 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:43:09 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:09 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.202s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] HCTL ('37', '0', '0', 0) found on session 36 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f7cb6b-c68e-4b31-8d3d-ac4d4a822cf3]: (4, ('0 0 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Searching for a device in session 36 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NQjZuhbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.234s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] <== connect_volume: return (235ms) {'type': 'block', 'scsi_wwn': '26461646464336234', 'path': '/dev/sdf'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461646464336234', 'path': '/dev/sdf'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1392926511',display_name='tempest-ServerStableDeviceRescueTest-server-1392926511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1392926511',id=29,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCldV0yuPoQiiDXH44VGXoIgKqgvSFBi6Hv9K7jeKgrzhKDrWQR5W3znD5kBdw6Jn+iX1rsymZxq81sNyNyQoFsCfnt2hU1HDWcY+plStJw6Cx9OHXS9dITlQF2ADPEWhg==',key_name='tempest-keypair-1336098653',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:38:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='667a324e48fd4a0e805b6abeaaf4e042',ramdisk_id='',reservation_id='r-118ruu2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-978011123',owner_user_name='tempest-ServerStableDeviceRescueTest-978011123-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78a41a82ce944e3292053de4cfb9f770',uuid=1ec0a113-9297-4a51-90fc-83951205185e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "vif_mac": "fa:16:3e:dd:71:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Converting VIF {"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "vif_mac": "fa:16:3e:dd:71:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:71:e8,bridge_name='br-int',has_traffic_filtering=True,id=5bd6bb7e-c803-4e38-a749-33e26c969d0b,network=Network(3f2414db-1d72-4464-a566-e13dc6cc475c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd6bb7e-c8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.instance [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.objects.base [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Object Instance<1ec0a113-9297-4a51-90fc-83951205185e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:43:09 user nova-compute[74295]:   <uuid>1ec0a113-9297-4a51-90fc-83951205185e</uuid>
Oct 26 06:43:09 user nova-compute[74295]:   <name>instance-0000001d</name>
Oct 26 06:43:09 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:43:09 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:43:09 user nova-compute[74295]:   <metadata>
Oct 26 06:43:09 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:43:09 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:43:09 user nova-compute[74295]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1392926511</nova:name>
Oct 26 06:43:09 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:43:09</nova:creationTime>
Oct 26 06:43:09 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:43:09 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:43:09 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:43:09 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:43:09 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:43:09 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:43:09 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:43:09 user nova-compute[74295]:       <nova:owner>
Oct 26 06:43:09 user nova-compute[74295]:         <nova:user uuid="78a41a82ce944e3292053de4cfb9f770">tempest-ServerStableDeviceRescueTest-978011123-project-member</nova:user>
Oct 26 06:43:09 user nova-compute[74295]:         <nova:project uuid="667a324e48fd4a0e805b6abeaaf4e042">tempest-ServerStableDeviceRescueTest-978011123</nova:project>
Oct 26 06:43:09 user nova-compute[74295]:       </nova:owner>
Oct 26 06:43:09 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:43:09 user nova-compute[74295]:       <nova:ports>
Oct 26 06:43:09 user nova-compute[74295]:         <nova:port uuid="5bd6bb7e-c803-4e38-a749-33e26c969d0b">
Oct 26 06:43:09 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 06:43:09 user nova-compute[74295]:         </nova:port>
Oct 26 06:43:09 user nova-compute[74295]:       </nova:ports>
Oct 26 06:43:09 user nova-compute[74295]:     </nova:instance>
Oct 26 06:43:09 user nova-compute[74295]:   </metadata>
Oct 26 06:43:09 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:43:09 user nova-compute[74295]:     <system>
Oct 26 06:43:09 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:43:09 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:43:09 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:43:09 user nova-compute[74295]:       <entry name="serial">1ec0a113-9297-4a51-90fc-83951205185e</entry>
Oct 26 06:43:09 user nova-compute[74295]:       <entry name="uuid">1ec0a113-9297-4a51-90fc-83951205185e</entry>
Oct 26 06:43:09 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:43:09 user nova-compute[74295]:     </system>
Oct 26 06:43:09 user nova-compute[74295]:   </sysinfo>
Oct 26 06:43:09 user nova-compute[74295]:   <os>
Oct 26 06:43:09 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:43:09 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:43:09 user nova-compute[74295]:   </os>
Oct 26 06:43:09 user nova-compute[74295]:   <features>
Oct 26 06:43:09 user nova-compute[74295]:     <acpi/>
Oct 26 06:43:09 user nova-compute[74295]:     <apic/>
Oct 26 06:43:09 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:43:09 user nova-compute[74295]:   </features>
Oct 26 06:43:09 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:43:09 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:43:09 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:43:09 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:43:09 user nova-compute[74295]:   </clock>
Oct 26 06:43:09 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:43:09 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:43:09 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:43:09 user nova-compute[74295]:   </cpu>
Oct 26 06:43:09 user nova-compute[74295]:   <devices>
Oct 26 06:43:09 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:43:09 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:43:09 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk"/>
Oct 26 06:43:09 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:43:09 user nova-compute[74295]:     </disk>
Oct 26 06:43:09 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:43:09 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:43:09 user nova-compute[74295]:       <source dev="/dev/sdf"/>
Oct 26 06:43:09 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:43:09 user nova-compute[74295]:       <serial>fb3a1533-688b-43ec-be06-8de3836fbf2b</serial>
Oct 26 06:43:09 user nova-compute[74295]:     </disk>
Oct 26 06:43:09 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:43:09 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:43:09 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue"/>
Oct 26 06:43:09 user nova-compute[74295]:       <target dev="vdc" bus="virtio"/>
Oct 26 06:43:09 user nova-compute[74295]:       <boot order="1"/>
Oct 26 06:43:09 user nova-compute[74295]:     </disk>
Oct 26 06:43:09 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:43:09 user nova-compute[74295]:       <mac address="fa:16:3e:dd:71:e8"/>
Oct 26 06:43:09 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:43:09 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:43:09 user nova-compute[74295]:       <target dev="tap5bd6bb7e-c8"/>
Oct 26 06:43:09 user nova-compute[74295]:     </interface>
Oct 26 06:43:09 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:43:09 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/console.log" append="off"/>
Oct 26 06:43:09 user nova-compute[74295]:     </serial>
Oct 26 06:43:09 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:43:09 user nova-compute[74295]:     <video>
Oct 26 06:43:09 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:43:09 user nova-compute[74295]:     </video>
Oct 26 06:43:09 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:43:09 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:43:09 user nova-compute[74295]:     </rng>
Oct 26 06:43:09 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:43:09 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:43:09 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:43:09 user nova-compute[74295]:     </memballoon>
Oct 26 06:43:09 user nova-compute[74295]:   </devices>
Oct 26 06:43:09 user nova-compute[74295]: </domain>
Oct 26 06:43:09 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:43:09 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Instance destroyed successfully.
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] No VIF found with MAC fa:16:3e:dd:71:e8, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received event network-vif-unplugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] No waiting events found dispatching network-vif-unplugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:09 user nova-compute[74295]: WARNING nova.compute.manager [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received unexpected event network-vif-unplugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d for instance with vm_state deleted and task_state None.
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received event network-vif-plugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] Acquiring lock "02d21159-fa28-4df3-b40b-031765d424c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] Lock "02d21159-fa28-4df3-b40b-031765d424c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] No waiting events found dispatching network-vif-plugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:09 user nova-compute[74295]: WARNING nova.compute.manager [req-dc9da6b7-ee01-4e82-9293-6206c870eab8 req-825e4258-69dd-4887-8bc2-37393f0f98f5 service nova] [instance: 02d21159-fa28-4df3-b40b-031765d424c2] Received unexpected event network-vif-plugged-7e4de530-6d56-4e35-a1b7-cbb3746ede9d for instance with vm_state deleted and task_state None.
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:43:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:09 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Deleted allocations for instance 02d21159-fa28-4df3-b40b-031765d424c2
Oct 26 06:43:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfd3c4c8-7ccb-4ee2-b8e0-9847287331f1 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "02d21159-fa28-4df3-b40b-031765d424c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:11 user nova-compute[74295]: WARNING nova.compute.manager [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state active and task_state rescuing.
Oct 26 06:43:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:11 user nova-compute[74295]: WARNING nova.compute.manager [req-c1714ab5-b5ef-4768-ae24-1395319c678f req-6d706ee8-df4c-48f3-9248-b2ca1cb26c54 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state active and task_state rescuing.
Oct 26 06:43:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:12 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:13 user nova-compute[74295]: INFO nova.compute.manager [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Terminating instance
Oct 26 06:43:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-111e8f56-2889-4b20-97b1-27bde6178f34 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-098ccd79-30c2-401d-93d4-17c3743535fc req-b0184b5e-159b-4ee0-8d5c-40193c6088d8 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-unplugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-098ccd79-30c2-401d-93d4-17c3743535fc req-b0184b5e-159b-4ee0-8d5c-40193c6088d8 service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-098ccd79-30c2-401d-93d4-17c3743535fc req-b0184b5e-159b-4ee0-8d5c-40193c6088d8 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-098ccd79-30c2-401d-93d4-17c3743535fc req-b0184b5e-159b-4ee0-8d5c-40193c6088d8 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-098ccd79-30c2-401d-93d4-17c3743535fc req-b0184b5e-159b-4ee0-8d5c-40193c6088d8 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-unplugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-098ccd79-30c2-401d-93d4-17c3743535fc req-b0184b5e-159b-4ee0-8d5c-40193c6088d8 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-unplugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Instance destroyed successfully.
Oct 26 06:43:14 user nova-compute[74295]: DEBUG nova.objects.instance [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'resources' on Instance uuid b1d6362b-2ffb-4574-8f19-48855f6e7869 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1772937373',display_name='tempest-ServerRescueNegativeTestJSON-server-1772937373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1772937373',id=5,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-a9t47yq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:28:06Z,user_data=None,user_id='3b0e86cf3ec049a58aee69c427717598',uuid=b1d6362b-2ffb-4574-8f19-48855f6e7869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "address": "fa:16:3e:98:89:6f", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0a9975-46", "ovs_interfaceid": "8f0a9975-465e-46c6-a0cf-777bcaf3a2df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f0a9975-465e-46c6-a0cf-777bcaf3a2df,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0a9975-46') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG os_vif [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f0a9975-465e-46c6-a0cf-777bcaf3a2df,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0a9975-46') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f0a9975-46, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0944779-a465-4444-8567-1340afb440c2) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:43:14 user nova-compute[74295]: INFO os_vif [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:89:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f0a9975-465e-46c6-a0cf-777bcaf3a2df,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0a9975-46')
Oct 26 06:43:14 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Deleting instance files /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869_del
Oct 26 06:43:14 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Deletion of /opt/stack/data/nova/instances/b1d6362b-2ffb-4574-8f19-48855f6e7869_del complete
Oct 26 06:43:14 user nova-compute[74295]: INFO nova.compute.manager [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 06:43:14 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:15 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:15 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Took 0.65 seconds to deallocate network for instance.
Oct 26 06:43:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-703716d0-50a3-461f-8d97-24d1d24638ad req-f8716ed1-6666-4abd-a5e3-fbbebe17a536 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-deleted-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:15 user nova-compute[74295]: INFO nova.compute.manager [req-703716d0-50a3-461f-8d97-24d1d24638ad req-f8716ed1-6666-4abd-a5e3-fbbebe17a536 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Neutron deleted interface 8f0a9975-465e-46c6-a0cf-777bcaf3a2df; detaching it from the instance and deleting it from the info cache
Oct 26 06:43:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-703716d0-50a3-461f-8d97-24d1d24638ad req-f8716ed1-6666-4abd-a5e3-fbbebe17a536 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-703716d0-50a3-461f-8d97-24d1d24638ad req-f8716ed1-6666-4abd-a5e3-fbbebe17a536 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Detach interface failed, port_id=8f0a9975-465e-46c6-a0cf-777bcaf3a2df, reason: Instance b1d6362b-2ffb-4574-8f19-48855f6e7869 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:43:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:15 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:43:15 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:43:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:15 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Deleted allocations for instance b1d6362b-2ffb-4574-8f19-48855f6e7869
Oct 26 06:43:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bde2ca23-71ec-4b35-bafd-0f3288dfc3d0 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.139s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_power_states {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:16 user nova-compute[74295]: WARNING nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state deleted and task_state None.
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:16 user nova-compute[74295]: WARNING nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state deleted and task_state None.
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:16 user nova-compute[74295]: WARNING nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state deleted and task_state None.
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-unplugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-unplugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:16 user nova-compute[74295]: WARNING nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-unplugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state deleted and task_state None.
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Acquiring lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] Lock "b1d6362b-2ffb-4574-8f19-48855f6e7869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] No waiting events found dispatching network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:16 user nova-compute[74295]: WARNING nova.compute.manager [req-8fcbcf78-29ff-4a4d-9358-2ce2f8b1f769 req-658775a4-6711-4351-97d0-1a180b123234 service nova] [instance: b1d6362b-2ffb-4574-8f19-48855f6e7869] Received unexpected event network-vif-plugged-8f0a9975-465e-46c6-a0cf-777bcaf3a2df for instance with vm_state deleted and task_state None.
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid c002695d-145c-4e74-90ae-aa1133680472 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 331e2afa-bf70-421f-b26d-ee3067d8aa64 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid fb03897e-7f9e-497a-b703-ca862b11672f {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid fe7578f8-07ed-4701-9292-9e1d10c5766c {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 6988db00-49d1-44d4-b383-7c52a2c2faf7 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 2a48ac34-3913-482f-91bd-7158c5b1f2bb {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "c002695d-145c-4e74-90ae-aa1133680472" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "331e2afa-bf70-421f-b26d-ee3067d8aa64" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "1ec0a113-9297-4a51-90fc-83951205185e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "6988db00-49d1-44d4-b383-7c52a2c2faf7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "1ec0a113-9297-4a51-90fc-83951205185e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "c002695d-145c-4e74-90ae-aa1133680472" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:43:16 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updating instance_info_cache with network_info: [{"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-4258d8a5-3e8b-4a4d-8ca6-420ece04e598" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:43:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:43:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:43:21 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:43:21 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:43:21 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7314MB free_disk=24.821975708007812GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:43:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fb03897e-7f9e-497a-b703-ca862b11672f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1ec0a113-9297-4a51-90fc-83951205185e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fe7578f8-07ed-4701-9292-9e1d10c5766c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 6988db00-49d1-44d4-b383-7c52a2c2faf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:22 user nova-compute[74295]: INFO nova.compute.manager [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Unshelving
Oct 26 06:43:22 user nova-compute[74295]: INFO nova.virt.block_device [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Booting with volume 665a14b7-df76-4938-91fb-6a1e1e03a433 at /dev/vda
Oct 26 06:43:22 user nova-compute[74295]: DEBUG os_brick.utils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba0b8cd-9486-4e89-a226-bfca1208eac5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8050b7-c57a-40b1-a70c-4f3bbab9c5fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53e123a-e409-4906-89df-ad993e5d0712]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7061a841-9922-4d82-a229-40d3e257633f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:43:22 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:43:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf91844-7f97-492e-bb38-1aa1cf800ecb]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG os_brick.utils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating existing volume attachment record: c57ecc70-221c-4e9e-873a-214e747bc606 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "6988db00-49d1-44d4-b383-7c52a2c2faf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:24 user nova-compute[74295]: INFO nova.compute.manager [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Terminating instance
Oct 26 06:43:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-85d206b0-224b-4411-a45d-4e7af7e1253c req-da350ee8-e9c0-498e-a6db-cef6d35d9cb2 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received event network-vif-unplugged-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-85d206b0-224b-4411-a45d-4e7af7e1253c req-da350ee8-e9c0-498e-a6db-cef6d35d9cb2 service nova] Acquiring lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-85d206b0-224b-4411-a45d-4e7af7e1253c req-da350ee8-e9c0-498e-a6db-cef6d35d9cb2 service nova] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-85d206b0-224b-4411-a45d-4e7af7e1253c req-da350ee8-e9c0-498e-a6db-cef6d35d9cb2 service nova] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-85d206b0-224b-4411-a45d-4e7af7e1253c req-da350ee8-e9c0-498e-a6db-cef6d35d9cb2 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] No waiting events found dispatching network-vif-unplugged-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-85d206b0-224b-4411-a45d-4e7af7e1253c req-da350ee8-e9c0-498e-a6db-cef6d35d9cb2 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received event network-vif-unplugged-62cc71c1-d718-453c-9df5-befb0c32e3ee for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Instance destroyed successfully.
Oct 26 06:43:24 user nova-compute[74295]: DEBUG nova.objects.instance [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'resources' on Instance uuid 6988db00-49d1-44d4-b383-7c52a2c2faf7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-178093482',display_name='tempest-TestVolumeBootPattern-server-178093482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-178093482',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-ubwgvmeb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:42:16Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=6988db00-49d1-44d4-b383-7c52a2c2faf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "address": "fa:16:3e:b2:66:7a", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cc71c1-d7", "ovs_interfaceid": "62cc71c1-d718-453c-9df5-befb0c32e3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:66:7a,bridge_name='br-int',has_traffic_filtering=True,id=62cc71c1-d718-453c-9df5-befb0c32e3ee,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cc71c1-d7') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_vif [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:66:7a,bridge_name='br-int',has_traffic_filtering=True,id=62cc71c1-d718-453c-9df5-befb0c32e3ee,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cc71c1-d7') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62cc71c1-d7, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38179a68-1471-43f9-8603-b5bcc3980f43) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:24 user nova-compute[74295]: INFO os_vif [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:66:7a,bridge_name='br-int',has_traffic_filtering=True,id=62cc71c1-d718-453c-9df5-befb0c32e3ee,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cc71c1-d7')
Oct 26 06:43:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mBIPHfkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:43:24 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a852e-e30c-4ddb-973e-3d7e58c1517e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:43:24 user nova-compute[74295]: No targets found.
Oct 26 06:43:24 user nova-compute[74295]: iSNS:
Oct 26 06:43:24 user nova-compute[74295]: No targets found.
Oct 26 06:43:24 user nova-compute[74295]: STATIC:
Oct 26 06:43:24 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca
Oct 26 06:43:24 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:43:24 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:43:24 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3
Oct 26 06:43:24 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:43:24 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:43:24 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:43:24 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:43:24 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:43:24 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:43:24 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:43:24 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:43:24 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b
Oct 26 06:43:24 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:43:24 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:43:24 user nova-compute[74295]: FIRMWARE:
Oct 26 06:43:24 user nova-compute[74295]: No targets found.
Oct 26 06:43:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:43:24 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:43:24 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f9a6e9-0c47-4901-a5cd-1229861a0c1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed6a15f-8b7c-4888-8544-b1e025cd0353]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:24 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:24 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:24 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:43:24 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:24 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:24 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:24 user nova-compute[74295]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca (non-flash)
Oct 26 06:43:24 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1b8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e981a29f-94c2-4942-9743-3cf59cf5e4e9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bfbc24-2b61-4c37-9fc3-09f274bd612c]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ebe7d-9776-4938-bc72-445804f6103a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:43:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab1ec29-3f4a-4810-ab9b-95cc4484d01d]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.128s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1654fb4-03d3-47a4-8d7b-9e59e9125eb7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b63fa5-ca49-456b-8d73-d2b7c12d9305]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca, portal: 172.16.0.220,3260]
Oct 26 06:43:25 user nova-compute[74295]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca, portal: 172.16.0.220,3260] successful.
Oct 26 06:43:25 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9485718d-7de0-4c53-aaf1-3ea9bff6fcca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d21b154-669b-492e-a540-9bea75180eeb]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.502s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== disconnect_volume: return (503ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:43:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Deleting instance files /opt/stack/data/nova/instances/6988db00-49d1-44d4-b383-7c52a2c2faf7_del
Oct 26 06:43:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Deletion of /opt/stack/data/nova/instances/6988db00-49d1-44d4-b383-7c52a2c2faf7_del complete
Oct 26 06:43:25 user nova-compute[74295]: INFO nova.compute.manager [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 26 06:43:25 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:43:25 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:25 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Took 0.39 seconds to deallocate network for instance.
Oct 26 06:43:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-4a91bd5b-85ec-48d0-ba18-cd5f70d226ea req-9e92d9bc-6dd0-4d1a-a2e0-ef572ecfaca7 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received event network-vif-plugged-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4a91bd5b-85ec-48d0-ba18-cd5f70d226ea req-9e92d9bc-6dd0-4d1a-a2e0-ef572ecfaca7 service nova] Acquiring lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4a91bd5b-85ec-48d0-ba18-cd5f70d226ea req-9e92d9bc-6dd0-4d1a-a2e0-ef572ecfaca7 service nova] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4a91bd5b-85ec-48d0-ba18-cd5f70d226ea req-9e92d9bc-6dd0-4d1a-a2e0-ef572ecfaca7 service nova] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-4a91bd5b-85ec-48d0-ba18-cd5f70d226ea req-9e92d9bc-6dd0-4d1a-a2e0-ef572ecfaca7 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] No waiting events found dispatching network-vif-plugged-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:26 user nova-compute[74295]: WARNING nova.compute.manager [req-4a91bd5b-85ec-48d0-ba18-cd5f70d226ea req-9e92d9bc-6dd0-4d1a-a2e0-ef572ecfaca7 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received unexpected event network-vif-plugged-62cc71c1-d718-453c-9df5-befb0c32e3ee for instance with vm_state active and task_state deleting.
Oct 26 06:43:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-4a91bd5b-85ec-48d0-ba18-cd5f70d226ea req-9e92d9bc-6dd0-4d1a-a2e0-ef572ecfaca7 service nova] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Received event network-vif-deleted-62cc71c1-d718-453c-9df5-befb0c32e3ee {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:26 user nova-compute[74295]: INFO nova.compute.manager [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Took 0.82 seconds to detach 1 volumes for instance.
Oct 26 06:43:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 6988db00-49d1-44d4-b383-7c52a2c2faf7] Deleting volume: 9485718d-7de0-4c53-aaf1-3ea9bff6fcca {{(pid=74295) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 06:43:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:27 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:43:27 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:43:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:27 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Deleted allocations for instance 6988db00-49d1-44d4-b383-7c52a2c2faf7
Oct 26 06:43:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-21154258-8370-47b0-b2b7-19af54d67128 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "6988db00-49d1-44d4-b383-7c52a2c2faf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.342s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:43:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-4f54e705-3d9c-4206-8adc-cec8156830de req-8fbb5382-a235-4a87-b849-74e4ce1f1c8d service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-changed-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-4f54e705-3d9c-4206-8adc-cec8156830de req-8fbb5382-a235-4a87-b849-74e4ce1f1c8d service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Refreshing instance network info cache due to event network-changed-f4dc83bc-fc9b-437c-a72c-e3f765165204. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:43:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4f54e705-3d9c-4206-8adc-cec8156830de req-8fbb5382-a235-4a87-b849-74e4ce1f1c8d service nova] Acquiring lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:43:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4f54e705-3d9c-4206-8adc-cec8156830de req-8fbb5382-a235-4a87-b849-74e4ce1f1c8d service nova] Acquired lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:43:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-4f54e705-3d9c-4206-8adc-cec8156830de req-8fbb5382-a235-4a87-b849-74e4ce1f1c8d service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Refreshing network info cache for port f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:43:35 user nova-compute[74295]: DEBUG nova.network.neutron [req-4f54e705-3d9c-4206-8adc-cec8156830de req-8fbb5382-a235-4a87-b849-74e4ce1f1c8d service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updated VIF entry in instance network info cache for port f4dc83bc-fc9b-437c-a72c-e3f765165204. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:43:35 user nova-compute[74295]: DEBUG nova.network.neutron [req-4f54e705-3d9c-4206-8adc-cec8156830de req-8fbb5382-a235-4a87-b849-74e4ce1f1c8d service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updating instance_info_cache with network_info: [{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4f54e705-3d9c-4206-8adc-cec8156830de req-8fbb5382-a235-4a87-b849-74e4ce1f1c8d service nova] Releasing lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:43:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG nova.objects.instance [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:41 user nova-compute[74295]: INFO nova.compute.manager [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Attaching volume 4a02d39a-927a-46ec-ae89-f307ce4d5573 to /dev/vdb
Oct 26 06:43:41 user nova-compute[74295]: DEBUG os_brick.utils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9a5edd-24c9-4262-8e7a-fd7461f6162e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[26547532-42d3-4137-8d47-a5dc61fd1012]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d329201c-9b4f-4542-a2a2-3bbff43a4470]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7119d-a381-45c5-82cf-39106da42163]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:43:41 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:43:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e01f53a-2e9d-4ef9-a94a-6c6822b4bc54]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG os_brick.utils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:43:41 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updating existing volume attachment record: b1b803e0-0cba-48b6-9e87-86ba5e51ac6d {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:43:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:42 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lazy-loading 'pci_requests' on Instance uuid c6fb7cff-07da-4441-b992-ec7fee6dd92b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:42 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lazy-loading 'numa_topology' on Instance uuid c6fb7cff-07da-4441-b992-ec7fee6dd92b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:42 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:43:42 user nova-compute[74295]: INFO nova.compute.claims [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Claim successful on node user
Oct 26 06:43:42 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:43:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:43:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:43 user nova-compute[74295]: INFO nova.network.neutron [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquired lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-63cabc69-772b-4d48-b310-b074a11aaeca req-769f5ded-f698-4bd6-8945-efd0ccd56086 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-63cabc69-772b-4d48-b310-b074a11aaeca req-769f5ded-f698-4bd6-8945-efd0ccd56086 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing instance network info cache due to event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-63cabc69-772b-4d48-b310-b074a11aaeca req-769f5ded-f698-4bd6-8945-efd0ccd56086 service nova] Acquiring lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating instance_info_cache with network_info: [{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Releasing lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:43:44 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Creating image(s)
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Ensure instance console log exists: /opt/stack/data/nova/instances/c6fb7cff-07da-4441-b992-ec7fee6dd92b/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Start _get_guest_xml network_info=[{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'c57ecc70-221c-4e9e-873a-214e747bc606', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuWserJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c6fb7cff-07da-4441-b992-ec7fee6dd92b', 'attached_at': '', 'detached_at': '', 'volume_id': '665a14b7-df76-4938-91fb-6a1e1e03a433', 'serial': '665a14b7-df76-4938-91fb-6a1e1e03a433'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-63cabc69-772b-4d48-b310-b074a11aaeca req-769f5ded-f698-4bd6-8945-efd0ccd56086 service nova] Acquired lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-63cabc69-772b-4d48-b310-b074a11aaeca req-769f5ded-f698-4bd6-8945-efd0ccd56086 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:43:44 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:43:44 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6fb7cff-07da-4441-b992-ec7fee6dd92b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.objects.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Object Instance<c6fb7cff-07da-4441-b992-ec7fee6dd92b> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuWserJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:43:44 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:43:44 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:43:44 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef311b3-25fc-4ac7-ab85-ee637720191a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:43:44 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0933d9de-fc6e-445f-ab3e-cd1c0291f43e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433] added
Oct 26 06:43:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[78091fd1-3de3-416d-a845-708053b90585]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a536fe45-698f-437c-8e1c-df9feb35d851]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuWserJE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuWserJE" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[313f20e1-1148-4910-a3e7-829b54a50131]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QuWserJE'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b769cff-68c3-4b62-88fe-179d25884e2e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5823a8-0d07-4ca1-9f90-e4bb5faa288c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb3ad9-350e-4dbe-8d3b-df9c15bab9bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260]
Oct 26 06:43:44 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260] successful.
Oct 26 06:43:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[031151b1-150b-4ef2-aa6d-3f42d7dd6d56]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fb3cde-c539-4bc1-8eea-a9505ea53682]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:43:44 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:43:44 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f64262-42ef-4d78-aa94-f88cb32ec5bd]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-63cabc69-772b-4d48-b310-b074a11aaeca req-769f5ded-f698-4bd6-8945-efd0ccd56086 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updated VIF entry in instance network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-63cabc69-772b-4d48-b310-b074a11aaeca req-769f5ded-f698-4bd6-8945-efd0ccd56086 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating instance_info_cache with network_info: [{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:43:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-63cabc69-772b-4d48-b310-b074a11aaeca req-769f5ded-f698-4bd6-8945-efd0ccd56086 service nova] Releasing lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuWserJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26537366330343161', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537366330343161', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:43:45 user nova-compute[74295]: INFO nova.compute.manager [None req-5ce24c41-c5bd-48e2-a172-882a7b7ed422 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Get console output
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1080291082',display_name='tempest-TestShelveInstance-server-1080291082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1080291082',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1955889839',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b1200573404a43989ba88c780574ffb4',ramdisk_id='',reservation_id='r-wt3jzqse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-930828987',owner_user_name='tempest-TestShelveInstance-930828987-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:43:23Z,user_data=None,user_id='030acfa99577474290cf4fe7e3aa7ed2',uuid=c6fb7cff-07da-4441-b992-ec7fee6dd92b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converting VIF {"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lazy-loading 'pci_devices' on Instance uuid c6fb7cff-07da-4441-b992-ec7fee6dd92b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.objects.base [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Object Instance<c6fb7cff-07da-4441-b992-ec7fee6dd92b> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:43:45 user nova-compute[74295]:   <uuid>c6fb7cff-07da-4441-b992-ec7fee6dd92b</uuid>
Oct 26 06:43:45 user nova-compute[74295]:   <name>instance-0000001c</name>
Oct 26 06:43:45 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:43:45 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:43:45 user nova-compute[74295]:   <metadata>
Oct 26 06:43:45 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:43:45 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:43:45 user nova-compute[74295]:       <nova:name>tempest-TestShelveInstance-server-1080291082</nova:name>
Oct 26 06:43:45 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:43:44</nova:creationTime>
Oct 26 06:43:45 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:43:45 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:43:45 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:43:45 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:43:45 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:43:45 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:43:45 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:43:45 user nova-compute[74295]:       <nova:owner>
Oct 26 06:43:45 user nova-compute[74295]:         <nova:user uuid="030acfa99577474290cf4fe7e3aa7ed2">tempest-TestShelveInstance-930828987-project-member</nova:user>
Oct 26 06:43:45 user nova-compute[74295]:         <nova:project uuid="b1200573404a43989ba88c780574ffb4">tempest-TestShelveInstance-930828987</nova:project>
Oct 26 06:43:45 user nova-compute[74295]:       </nova:owner>
Oct 26 06:43:45 user nova-compute[74295]:       <nova:ports>
Oct 26 06:43:45 user nova-compute[74295]:         <nova:port uuid="4ecd91eb-3d2e-404b-88f0-1cb61e06732f">
Oct 26 06:43:45 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 06:43:45 user nova-compute[74295]:         </nova:port>
Oct 26 06:43:45 user nova-compute[74295]:       </nova:ports>
Oct 26 06:43:45 user nova-compute[74295]:     </nova:instance>
Oct 26 06:43:45 user nova-compute[74295]:   </metadata>
Oct 26 06:43:45 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:43:45 user nova-compute[74295]:     <system>
Oct 26 06:43:45 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:43:45 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:43:45 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:43:45 user nova-compute[74295]:       <entry name="serial">c6fb7cff-07da-4441-b992-ec7fee6dd92b</entry>
Oct 26 06:43:45 user nova-compute[74295]:       <entry name="uuid">c6fb7cff-07da-4441-b992-ec7fee6dd92b</entry>
Oct 26 06:43:45 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:43:45 user nova-compute[74295]:     </system>
Oct 26 06:43:45 user nova-compute[74295]:   </sysinfo>
Oct 26 06:43:45 user nova-compute[74295]:   <os>
Oct 26 06:43:45 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:43:45 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:43:45 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:43:45 user nova-compute[74295]:   </os>
Oct 26 06:43:45 user nova-compute[74295]:   <features>
Oct 26 06:43:45 user nova-compute[74295]:     <acpi/>
Oct 26 06:43:45 user nova-compute[74295]:     <apic/>
Oct 26 06:43:45 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:43:45 user nova-compute[74295]:   </features>
Oct 26 06:43:45 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:43:45 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:43:45 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:43:45 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:43:45 user nova-compute[74295]:   </clock>
Oct 26 06:43:45 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:43:45 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:43:45 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:43:45 user nova-compute[74295]:   </cpu>
Oct 26 06:43:45 user nova-compute[74295]:   <devices>
Oct 26 06:43:45 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:43:45 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:43:45 user nova-compute[74295]:       <source dev="/dev/sdd"/>
Oct 26 06:43:45 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:43:45 user nova-compute[74295]:       <serial>665a14b7-df76-4938-91fb-6a1e1e03a433</serial>
Oct 26 06:43:45 user nova-compute[74295]:     </disk>
Oct 26 06:43:45 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:43:45 user nova-compute[74295]:       <mac address="fa:16:3e:c9:6e:99"/>
Oct 26 06:43:45 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:43:45 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:43:45 user nova-compute[74295]:       <target dev="tap4ecd91eb-3d"/>
Oct 26 06:43:45 user nova-compute[74295]:     </interface>
Oct 26 06:43:45 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:43:45 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/c6fb7cff-07da-4441-b992-ec7fee6dd92b/console.log" append="off"/>
Oct 26 06:43:45 user nova-compute[74295]:     </serial>
Oct 26 06:43:45 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:43:45 user nova-compute[74295]:     <video>
Oct 26 06:43:45 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:43:45 user nova-compute[74295]:     </video>
Oct 26 06:43:45 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:43:45 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:43:45 user nova-compute[74295]:     </rng>
Oct 26 06:43:45 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:43:45 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:43:45 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:43:45 user nova-compute[74295]:     </memballoon>
Oct 26 06:43:45 user nova-compute[74295]:   </devices>
Oct 26 06:43:45 user nova-compute[74295]: </domain>
Oct 26 06:43:45 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1080291082',display_name='tempest-TestShelveInstance-server-1080291082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1080291082',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1955889839',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b1200573404a43989ba88c780574ffb4',ramdisk_id='',reservation_id='r-wt3jzqse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-930828987',owner_user_name='tempest-TestShelveInstance-930828987-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:43:23Z,user_data=None,user_id='030acfa99577474290cf4fe7e3aa7ed2',uuid=c6fb7cff-07da-4441-b992-ec7fee6dd92b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converting VIF {"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG os_vif [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fd4d428-2624-5a0c-864d-7c6952afdae7', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ecd91eb-3d, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ecd91eb-3d, col_values=(('qos', UUID('a241c6e3-8834-4d44-b5ef-7c668ff2f486')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ecd91eb-3d, col_values=(('external_ids', {'iface-id': '4ecd91eb-3d2e-404b-88f0-1cb61e06732f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:6e:99', 'vm-uuid': 'c6fb7cff-07da-4441-b992-ec7fee6dd92b'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:45 user nova-compute[74295]: INFO os_vif [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d')
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:43:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] No VIF found with MAC fa:16:3e:c9:6e:99, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:43:46 user nova-compute[74295]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 26 06:43:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-9898fc0c-1e30-4f22-9ff7-7e9b10fbc0e4 req-09a30e24-5ddf-482f-bc99-2a86c2e30481 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9898fc0c-1e30-4f22-9ff7-7e9b10fbc0e4 req-09a30e24-5ddf-482f-bc99-2a86c2e30481 service nova] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9898fc0c-1e30-4f22-9ff7-7e9b10fbc0e4 req-09a30e24-5ddf-482f-bc99-2a86c2e30481 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9898fc0c-1e30-4f22-9ff7-7e9b10fbc0e4 req-09a30e24-5ddf-482f-bc99-2a86c2e30481 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-9898fc0c-1e30-4f22-9ff7-7e9b10fbc0e4 req-09a30e24-5ddf-482f-bc99-2a86c2e30481 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] No waiting events found dispatching network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:47 user nova-compute[74295]: WARNING nova.compute.manager [req-9898fc0c-1e30-4f22-9ff7-7e9b10fbc0e4 req-09a30e24-5ddf-482f-bc99-2a86c2e30481 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received unexpected event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 06:43:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:43:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:43:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Instance spawned successfully.
Oct 26 06:43:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:43:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f9c49116-73c0-41d7-9af4-cfcf5c9ca084 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.748s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-6bdc6f90-f430-4f81-b43f-ac01d29343a9 req-f6b2e280-c204-4a0d-8679-37fefd5fc4ad service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:43:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6bdc6f90-f430-4f81-b43f-ac01d29343a9 req-f6b2e280-c204-4a0d-8679-37fefd5fc4ad service nova] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:43:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6bdc6f90-f430-4f81-b43f-ac01d29343a9 req-f6b2e280-c204-4a0d-8679-37fefd5fc4ad service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:43:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6bdc6f90-f430-4f81-b43f-ac01d29343a9 req-f6b2e280-c204-4a0d-8679-37fefd5fc4ad service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:43:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-6bdc6f90-f430-4f81-b43f-ac01d29343a9 req-f6b2e280-c204-4a0d-8679-37fefd5fc4ad service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] No waiting events found dispatching network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:43:49 user nova-compute[74295]: WARNING nova.compute.manager [req-6bdc6f90-f430-4f81-b43f-ac01d29343a9 req-f6b2e280-c204-4a0d-8679-37fefd5fc4ad service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received unexpected event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f for instance with vm_state active and task_state None.
Oct 26 06:43:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:43:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:44:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwBYQqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:44:00 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:44:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:44:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:44:00 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:44:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:44:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:44:00 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:44:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba7f642-cbc3-40a8-83d3-8ce593dbceb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:44:01 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b95f292-d098-4c23-84c0-44d2c76ad0d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573] added
Oct 26 06:44:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6830c0a8-837a-48a7-b84e-bca5813fab0c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7749ad-b932-427b-92a5-638e072b4da9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwBYQqST {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwBYQqST" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bca9a1-6df2-4fc1-9fa6-0703e62eba2d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwBYQqST'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[add5fa8d-07f0-428f-b080-88aecc1e33ba]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab92b6-93ce-4c19-ac08-74abe4148aea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77b6c58-45cb-4f73-8c44-1cb74344485f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260]
Oct 26 06:44:01 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260] successful.
Oct 26 06:44:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f282183b-085f-45a5-8d90-0d3083de3dbb]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb93e44-b226-4aae-ab59-b07957eb64d8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:44:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6ed183-7888-4fb0-a684-0658249eb8a8]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:44:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwBYQqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23363323934346438', 'path': '/dev/sdg'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363323934346438', 'path': '/dev/sdg'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG nova.objects.instance [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:44:02 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:44:02 user nova-compute[74295]:   <source dev="/dev/sdg"/>
Oct 26 06:44:02 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:44:02 user nova-compute[74295]:   <serial>4a02d39a-927a-46ec-ae89-f307ce4d5573</serial>
Oct 26 06:44:02 user nova-compute[74295]: </disk>
Oct 26 06:44:02 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No VIF found with MAC fa:16:3e:ba:0d:a5, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:44:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0b122c6c-622b-4127-9df9-8547da046d02 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.536s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4b13c2fd-1697-4e00-8fee-a71ef5baceb9 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4b13c2fd-1697-4e00-8fee-a71ef5baceb9 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-4b13c2fd-1697-4e00-8fee-a71ef5baceb9 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:44:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-4b13c2fd-1697-4e00-8fee-a71ef5baceb9 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74295) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 06:44:03 user nova-compute[74295]: DEBUG nova.objects.instance [None req-4b13c2fd-1697-4e00-8fee-a71ef5baceb9 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:04 user nova-compute[74295]: INFO nova.compute.manager [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Terminating instance
Oct 26 06:44:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-074b9bd9-c7f0-4772-837f-4c6b7a381307 req-5d748f07-903e-47e5-b3b6-e59933bef29a service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-unplugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-074b9bd9-c7f0-4772-837f-4c6b7a381307 req-5d748f07-903e-47e5-b3b6-e59933bef29a service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-074b9bd9-c7f0-4772-837f-4c6b7a381307 req-5d748f07-903e-47e5-b3b6-e59933bef29a service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-074b9bd9-c7f0-4772-837f-4c6b7a381307 req-5d748f07-903e-47e5-b3b6-e59933bef29a service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-074b9bd9-c7f0-4772-837f-4c6b7a381307 req-5d748f07-903e-47e5-b3b6-e59933bef29a service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-unplugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:04 user nova-compute[74295]: WARNING nova.compute.manager [req-074b9bd9-c7f0-4772-837f-4c6b7a381307 req-5d748f07-903e-47e5-b3b6-e59933bef29a service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-unplugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state active and task_state powering-off.
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Instance destroyed successfully.
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.objects.instance [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lazy-loading 'resources' on Instance uuid 9f9f523a-896e-414d-a24e-ba2c6b6a9834 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:44:05 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance destroyed successfully.
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-4b13c2fd-1697-4e00-8fee-a71ef5baceb9 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1634403107',display_name='tempest-ServerRescueNegativeTestJSON-server-1634403107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1634403107',id=3,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65c33a42f4b946d28de9e355927737e8',ramdisk_id='',reservation_id='r-rxppw34g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1373728584',owner_user_name='tempest-ServerRescueNegativeTestJSON-1373728584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:32:56Z,user_data=None,user_id='3b0e86cf3ec049a58aee69c427717598',uuid=9f9f523a-896e-414d-a24e-ba2c6b6a9834,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converting VIF {"id": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "address": "fa:16:3e:5c:16:4d", "network": {"id": "2d8289b4-a1ed-4393-b573-da281f737629", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-552787828-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65c33a42f4b946d28de9e355927737e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbea3168-b2", "ovs_interfaceid": "fbea3168-b2c6-4ca2-bad1-949003900aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:16:4d,bridge_name='br-int',has_traffic_filtering=True,id=fbea3168-b2c6-4ca2-bad1-949003900aa0,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbea3168-b2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG os_vif [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:16:4d,bridge_name='br-int',has_traffic_filtering=True,id=fbea3168-b2c6-4ca2-bad1-949003900aa0,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbea3168-b2') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbea3168-b2, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e57a8644-b5ce-4636-aebd-26f97e907af0) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: INFO os_vif [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:16:4d,bridge_name='br-int',has_traffic_filtering=True,id=fbea3168-b2c6-4ca2-bad1-949003900aa0,network=Network(2d8289b4-a1ed-4393-b573-da281f737629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbea3168-b2')
Oct 26 06:44:05 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Deleting instance files /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834_del
Oct 26 06:44:05 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Deletion of /opt/stack/data/nova/instances/9f9f523a-896e-414d-a24e-ba2c6b6a9834_del complete
Oct 26 06:44:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4b13c2fd-1697-4e00-8fee-a71ef5baceb9 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.368s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:05 user nova-compute[74295]: INFO nova.compute.manager [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 26 06:44:05 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:05 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Took 0.49 seconds to deallocate network for instance.
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-e1f3df49-274f-4caf-92b4-6b8c05a080cb req-1d1daef6-8b80-4704-a824-e6b5bff9680f service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-deleted-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:05 user nova-compute[74295]: INFO nova.compute.manager [req-e1f3df49-274f-4caf-92b4-6b8c05a080cb req-1d1daef6-8b80-4704-a824-e6b5bff9680f service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Neutron deleted interface fbea3168-b2c6-4ca2-bad1-949003900aa0; detaching it from the instance and deleting it from the info cache
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.network.neutron [req-e1f3df49-274f-4caf-92b4-6b8c05a080cb req-1d1daef6-8b80-4704-a824-e6b5bff9680f service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-e1f3df49-274f-4caf-92b4-6b8c05a080cb req-1d1daef6-8b80-4704-a824-e6b5bff9680f service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Detach interface failed, port_id=fbea3168-b2c6-4ca2-bad1-949003900aa0, reason: Instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:06 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Deleted allocations for instance 9f9f523a-896e-414d-a24e-ba2c6b6a9834
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa09ac0c-8bba-47f6-b9e5-65bb5158c100 tempest-ServerRescueNegativeTestJSON-1373728584 tempest-ServerRescueNegativeTestJSON-1373728584-project-member] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:06 user nova-compute[74295]: WARNING nova.compute.manager [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state stopped and task_state None.
Oct 26 06:44:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:06 user nova-compute[74295]: WARNING nova.compute.manager [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-unplugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state deleted and task_state None.
Oct 26 06:44:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] Acquiring lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] Lock "9f9f523a-896e-414d-a24e-ba2c6b6a9834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] No waiting events found dispatching network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:06 user nova-compute[74295]: WARNING nova.compute.manager [req-d400e195-3062-4ef1-8d4f-08c4a6e8afda req-5f18221d-ccec-49ea-9e44-959b1d737d5b service nova] [instance: 9f9f523a-896e-414d-a24e-ba2c6b6a9834] Received unexpected event network-vif-plugged-fbea3168-b2c6-4ca2-bad1-949003900aa0 for instance with vm_state deleted and task_state None.
Oct 26 06:44:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:07 user nova-compute[74295]: INFO nova.compute.manager [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Terminating instance
Oct 26 06:44:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9fca9a1-c4f4-4bb8-82c6-c27b2943e267 req-b2495a3d-5684-4af0-acd6-03365d8a6e94 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-unplugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9fca9a1-c4f4-4bb8-82c6-c27b2943e267 req-b2495a3d-5684-4af0-acd6-03365d8a6e94 service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9fca9a1-c4f4-4bb8-82c6-c27b2943e267 req-b2495a3d-5684-4af0-acd6-03365d8a6e94 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f9fca9a1-c4f4-4bb8-82c6-c27b2943e267 req-b2495a3d-5684-4af0-acd6-03365d8a6e94 service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9fca9a1-c4f4-4bb8-82c6-c27b2943e267 req-b2495a3d-5684-4af0-acd6-03365d8a6e94 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-unplugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG nova.compute.manager [req-f9fca9a1-c4f4-4bb8-82c6-c27b2943e267 req-b2495a3d-5684-4af0-acd6-03365d8a6e94 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-unplugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Instance destroyed successfully.
Oct 26 06:44:08 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'resources' on Instance uuid 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:37:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-90833333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-90833333',id=26,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:40:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-9hmvlt98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:42:21Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "67ebefae-3edf-4872-85a7-afa6222db4df", "address": "fa:16:3e:fd:af:21", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ebefae-3e", "ovs_interfaceid": "67ebefae-3edf-4872-85a7-afa6222db4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:af:21,bridge_name='br-int',has_traffic_filtering=True,id=67ebefae-3edf-4872-85a7-afa6222db4df,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ebefae-3e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_vif [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:af:21,bridge_name='br-int',has_traffic_filtering=True,id=67ebefae-3edf-4872-85a7-afa6222db4df,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ebefae-3e') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67ebefae-3e, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd2bbb2c-41c4-4c6f-96b4-8750e1cb68e6) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:08 user nova-compute[74295]: INFO os_vif [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:af:21,bridge_name='br-int',has_traffic_filtering=True,id=67ebefae-3edf-4872-85a7-afa6222db4df,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ebefae-3e')
Oct 26 06:44:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvHscawf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:44:08 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e948234f-ecbe-4bb5-a19b-8f90f0154cad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:44:08 user nova-compute[74295]: No targets found.
Oct 26 06:44:08 user nova-compute[74295]: iSNS:
Oct 26 06:44:08 user nova-compute[74295]: No targets found.
Oct 26 06:44:08 user nova-compute[74295]: STATIC:
Oct 26 06:44:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573
Oct 26 06:44:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3
Oct 26 06:44:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd
Oct 26 06:44:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433
Oct 26 06:44:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:44:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:08 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b
Oct 26 06:44:08 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:08 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:08 user nova-compute[74295]: FIRMWARE:
Oct 26 06:44:08 user nova-compute[74295]: No targets found.
Oct 26 06:44:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:44:08 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:44:08 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a64dce6-9d8f-464f-81bd-d38a8d6ea5b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f1a46-4c7c-4038-835b-ec30b7fe4cc7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:44:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:44:08 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:44:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1eed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a2fb33-e53f-478f-8a93-939a99a5ff90]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea7c210-60c2-4445-85cc-e12772659eb2]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[81859343-6e09-4c8d-a713-023ed46243a9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[879eac80-9071-4e5b-b64d-a3531486a9b9]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd9a7b02-7c089ae2abbef3cd', '/dev/disk/by-id/scsi-23763303839616532', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d9a7b02') {{(pid=85963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c1c944-3bc5-49c5-8728-2255502080c8]: (4, None) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[213902ec-9876-49eb-bc90-421155a0d78d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8bc1c9-5e50-45fe-9208-6307322dce3c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd, portal: 172.16.0.220,3260]
Oct 26 06:44:08 user nova-compute[74295]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd, portal: 172.16.0.220,3260] successful.
Oct 26 06:44:08 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c38de5f0-842d-4c0d-aa3d-208096993ccd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5c0ade-4427-436b-bcbb-766b79547507]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] <== disconnect_volume: return (378ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:44:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Deleting instance files /opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7_del
Oct 26 06:44:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Deletion of /opt/stack/data/nova/instances/29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7_del complete
Oct 26 06:44:08 user nova-compute[74295]: INFO nova.compute.manager [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 26 06:44:08 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:44:08 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:44:09 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:09 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Took 0.48 seconds to deallocate network for instance.
Oct 26 06:44:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-41959b7e-d3b7-49b5-aaa4-e2617ffd8961 req-155210d3-09fa-4a5a-87f1-feb0586293b3 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-deleted-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:09 user nova-compute[74295]: INFO nova.compute.manager [req-41959b7e-d3b7-49b5-aaa4-e2617ffd8961 req-155210d3-09fa-4a5a-87f1-feb0586293b3 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Neutron deleted interface 67ebefae-3edf-4872-85a7-afa6222db4df; detaching it from the instance and deleting it from the info cache
Oct 26 06:44:09 user nova-compute[74295]: DEBUG nova.network.neutron [req-41959b7e-d3b7-49b5-aaa4-e2617ffd8961 req-155210d3-09fa-4a5a-87f1-feb0586293b3 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-41959b7e-d3b7-49b5-aaa4-e2617ffd8961 req-155210d3-09fa-4a5a-87f1-feb0586293b3 service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Detach interface failed, port_id=67ebefae-3edf-4872-85a7-afa6222db4df, reason: Instance 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:44:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-96590b16-ec50-4fab-a9cb-ec0968ec20ea req-b7d18592-d4dd-4217-b091-a2e56f16f8aa service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-96590b16-ec50-4fab-a9cb-ec0968ec20ea req-b7d18592-d4dd-4217-b091-a2e56f16f8aa service nova] Acquiring lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-96590b16-ec50-4fab-a9cb-ec0968ec20ea req-b7d18592-d4dd-4217-b091-a2e56f16f8aa service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-96590b16-ec50-4fab-a9cb-ec0968ec20ea req-b7d18592-d4dd-4217-b091-a2e56f16f8aa service nova] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-96590b16-ec50-4fab-a9cb-ec0968ec20ea req-b7d18592-d4dd-4217-b091-a2e56f16f8aa service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] No waiting events found dispatching network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:09 user nova-compute[74295]: WARNING nova.compute.manager [req-96590b16-ec50-4fab-a9cb-ec0968ec20ea req-b7d18592-d4dd-4217-b091-a2e56f16f8aa service nova] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Received unexpected event network-vif-plugged-67ebefae-3edf-4872-85a7-afa6222db4df for instance with vm_state active and task_state deleting.
Oct 26 06:44:10 user nova-compute[74295]: INFO nova.compute.manager [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7] Took 0.89 seconds to detach 1 volumes for instance.
Oct 26 06:44:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:10 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:44:10 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:44:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:10 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Deleted allocations for instance 29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7
Oct 26 06:44:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b55672ef-6a65-4aed-b29b-4b2221e4e59f tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "29fbc63d-ed8a-40d9-90a5-cf0b8032ebd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.204s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:12 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:12 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:44:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:18 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:44:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:44:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:44:18 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updating instance_info_cache with network_info: [{"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-563360ea-d5ca-4006-9c23-3bf9aac300ce" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a96a354b-a61e-4f9e-9481-d03ca6a321dd req-ef0db3e8-5fcf-4e94-bdfc-0830fd920539 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-changed-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a96a354b-a61e-4f9e-9481-d03ca6a321dd req-ef0db3e8-5fcf-4e94-bdfc-0830fd920539 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Refreshing instance network info cache due to event network-changed-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a96a354b-a61e-4f9e-9481-d03ca6a321dd req-ef0db3e8-5fcf-4e94-bdfc-0830fd920539 service nova] Acquiring lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a96a354b-a61e-4f9e-9481-d03ca6a321dd req-ef0db3e8-5fcf-4e94-bdfc-0830fd920539 service nova] Acquired lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG nova.network.neutron [req-a96a354b-a61e-4f9e-9481-d03ca6a321dd req-ef0db3e8-5fcf-4e94-bdfc-0830fd920539 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Refreshing network info cache for port d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:19 user nova-compute[74295]: INFO nova.compute.manager [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Terminating instance
Oct 26 06:44:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-f616a750-6fdd-4996-bb96-53d6f3810b5c req-f8273961-1721-4a79-aa4e-9249a2c264d7 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-unplugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f616a750-6fdd-4996-bb96-53d6f3810b5c req-f8273961-1721-4a79-aa4e-9249a2c264d7 service nova] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f616a750-6fdd-4996-bb96-53d6f3810b5c req-f8273961-1721-4a79-aa4e-9249a2c264d7 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f616a750-6fdd-4996-bb96-53d6f3810b5c req-f8273961-1721-4a79-aa4e-9249a2c264d7 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-f616a750-6fdd-4996-bb96-53d6f3810b5c req-f8273961-1721-4a79-aa4e-9249a2c264d7 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] No waiting events found dispatching network-vif-unplugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-f616a750-6fdd-4996-bb96-53d6f3810b5c req-f8273961-1721-4a79-aa4e-9249a2c264d7 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-unplugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.network.neutron [req-a96a354b-a61e-4f9e-9481-d03ca6a321dd req-ef0db3e8-5fcf-4e94-bdfc-0830fd920539 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Updated VIF entry in instance network info cache for port d745ae1a-25c3-4f4e-bfaa-4462ae430dc9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.network.neutron [req-a96a354b-a61e-4f9e-9481-d03ca6a321dd req-ef0db3e8-5fcf-4e94-bdfc-0830fd920539 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Updating instance_info_cache with network_info: [{"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a96a354b-a61e-4f9e-9481-d03ca6a321dd req-ef0db3e8-5fcf-4e94-bdfc-0830fd920539 service nova] Releasing lock "refresh_cache-fb03897e-7f9e-497a-b703-ca862b11672f" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Instance destroyed successfully.
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lazy-loading 'resources' on Instance uuid fb03897e-7f9e-497a-b703-ca862b11672f {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-474204970',display_name='tempest-TestStampPattern-server-474204970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-474204970',id=25,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSEAdKcn8BfIKAadtFceMe64jXIA47ijBG6BK3Cx0+eFXmVCy7VFEkebqDvzRsQ0zTl6IjK9Qm73ynWPZigB9lmyvdFYYVp4BU04c1HSaUw88rA3kLK5vGAV3HV0ee2Bw==',key_name='tempest-TestStampPattern-1605295167',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:36:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8af562736824561a4f55f68f27a0b85',ramdisk_id='',reservation_id='r-w394cdzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-91727882',owner_user_name='tempest-TestStampPattern-91727882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:39:45Z,user_data=None,user_id='5f6d23275c654de1926a7cb988451d10',uuid=fb03897e-7f9e-497a-b703-ca862b11672f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converting VIF {"id": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "address": "fa:16:3e:6f:31:20", "network": {"id": "7936275d-3565-424b-9704-034e722cac3f", "bridge": "br-int", "label": "tempest-TestStampPattern-1915817070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8af562736824561a4f55f68f27a0b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd745ae1a-25", "ovs_interfaceid": "d745ae1a-25c3-4f4e-bfaa-4462ae430dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:31:20,bridge_name='br-int',has_traffic_filtering=True,id=d745ae1a-25c3-4f4e-bfaa-4462ae430dc9,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd745ae1a-25') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG os_vif [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:31:20,bridge_name='br-int',has_traffic_filtering=True,id=d745ae1a-25c3-4f4e-bfaa-4462ae430dc9,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd745ae1a-25') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd745ae1a-25, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e294dc96-b554-41b3-8c80-f8f02bc9d24f) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:20 user nova-compute[74295]: INFO os_vif [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:31:20,bridge_name='br-int',has_traffic_filtering=True,id=d745ae1a-25c3-4f4e-bfaa-4462ae430dc9,network=Network(7936275d-3565-424b-9704-034e722cac3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd745ae1a-25')
Oct 26 06:44:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Deleting instance files /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f_del
Oct 26 06:44:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Deletion of /opt/stack/data/nova/instances/fb03897e-7f9e-497a-b703-ca862b11672f_del complete
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:20 user nova-compute[74295]: INFO nova.compute.manager [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:44:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:21 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Took 0.82 seconds to deallocate network for instance.
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:44:21 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Error from libvirt while getting description of instance-00000019: [Error Code 42] Domain not found: no domain with matching uuid 'fb03897e-7f9e-497a-b703-ca862b11672f' (instance-00000019): libvirt.libvirtError: Domain not found: no domain with matching uuid 'fb03897e-7f9e-497a-b703-ca862b11672f' (instance-00000019)
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:21 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Deleted allocations for instance fb03897e-7f9e-497a-b703-ca862b11672f
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] No waiting events found dispatching network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:22 user nova-compute[74295]: WARNING nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received unexpected event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 for instance with vm_state deleted and task_state None.
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] No waiting events found dispatching network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:22 user nova-compute[74295]: WARNING nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received unexpected event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 for instance with vm_state deleted and task_state None.
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] No waiting events found dispatching network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:22 user nova-compute[74295]: WARNING nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received unexpected event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 for instance with vm_state deleted and task_state None.
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-unplugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] No waiting events found dispatching network-vif-unplugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:22 user nova-compute[74295]: WARNING nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received unexpected event network-vif-unplugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 for instance with vm_state deleted and task_state None.
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Acquiring lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] Lock "fb03897e-7f9e-497a-b703-ca862b11672f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] No waiting events found dispatching network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:22 user nova-compute[74295]: WARNING nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received unexpected event network-vif-plugged-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 for instance with vm_state deleted and task_state None.
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cd2ec5cf-f994-4d5e-b1d0-2cb1b1c97d7c req-ef8de0f3-1a21-4a1d-a220-38b8d2db2178 service nova] [instance: fb03897e-7f9e-497a-b703-ca862b11672f] Received event network-vif-deleted-d745ae1a-25c3-4f4e-bfaa-4462ae430dc9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5737e886-85d1-48eb-832f-014125480f26 tempest-TestStampPattern-91727882 tempest-TestStampPattern-91727882-project-member] Lock "fb03897e-7f9e-497a-b703-ca862b11672f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.498s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:44:22 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:44:22 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=7549MB free_disk=24.915538787841797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 331e2afa-bf70-421f-b26d-ee3067d8aa64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1ec0a113-9297-4a51-90fc-83951205185e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance fe7578f8-07ed-4701-9292-9e1d10c5766c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c6fb7cff-07da-4441-b992-ec7fee6dd92b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:44:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:44:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:46 user nova-compute[74295]: INFO nova.compute.manager [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Terminating instance
Oct 26 06:44:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:44:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-bbdab45b-b8ac-4894-a4f3-20ed155b20a4 req-2b4ab1fd-c95c-48f1-ad8e-911e74c36392 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-unplugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bbdab45b-b8ac-4894-a4f3-20ed155b20a4 req-2b4ab1fd-c95c-48f1-ad8e-911e74c36392 service nova] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bbdab45b-b8ac-4894-a4f3-20ed155b20a4 req-2b4ab1fd-c95c-48f1-ad8e-911e74c36392 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bbdab45b-b8ac-4894-a4f3-20ed155b20a4 req-2b4ab1fd-c95c-48f1-ad8e-911e74c36392 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-bbdab45b-b8ac-4894-a4f3-20ed155b20a4 req-2b4ab1fd-c95c-48f1-ad8e-911e74c36392 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] No waiting events found dispatching network-vif-unplugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-bbdab45b-b8ac-4894-a4f3-20ed155b20a4 req-2b4ab1fd-c95c-48f1-ad8e-911e74c36392 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-unplugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Instance destroyed successfully.
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.objects.instance [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'resources' on Instance uuid fe7578f8-07ed-4701-9292-9e1d10c5766c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-805152837',display_name='tempest-ServerActionsTestOtherA-server-805152837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-805152837',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEalUstBq4vFH7qnNchfBeKikF9/lcUlFw9j5QYSoSoqdNDpcgRH/nIAEmyjwdsmFPjVTLPazAWFfDhK1wvnJyZTilappqjUYF52/w6x/BiOg104d9g3zNtJX38DMWLdw==',key_name='tempest-keypair-977042820',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:40:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-vy2gwlqf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=fe7578f8-07ed-4701-9292-9e1d10c5766c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "address": "fa:16:3e:af:83:c7", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc714b43-0e", "ovs_interfaceid": "bc714b43-0ed1-4b49-b1f8-a5eddbf64206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_vif [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc714b43-0e, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be21c76a-cf60-4167-ad83-ab533bd17f9d) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: INFO os_vif [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:83:c7,bridge_name='br-int',has_traffic_filtering=True,id=bc714b43-0ed1-4b49-b1f8-a5eddbf64206,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc714b43-0e')
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oABNVibs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:44:47 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff24ab0a-e1c9-4f51-85ce-943a84eab52b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:44:47 user nova-compute[74295]: No targets found.
Oct 26 06:44:47 user nova-compute[74295]: iSNS:
Oct 26 06:44:47 user nova-compute[74295]: No targets found.
Oct 26 06:44:47 user nova-compute[74295]: STATIC:
Oct 26 06:44:47 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573
Oct 26 06:44:47 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:47 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:47 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3
Oct 26 06:44:47 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:47 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:47 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433
Oct 26 06:44:47 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:47 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:47 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:44:47 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:47 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:47 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b
Oct 26 06:44:47 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:44:47 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:44:47 user nova-compute[74295]: FIRMWARE:
Oct 26 06:44:47 user nova-compute[74295]: No targets found.
Oct 26 06:44:47 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:44:47 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:44:47 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31d2de0-2a20-4dd7-b0a9-f566a9aa91c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62c6ff8-e9f2-4827-b16f-1baa3ee3850a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:44:47 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:44:47 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:44:47 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:44:47 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:44:47 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:44:47 user nova-compute[74295]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 (non-flash)
Oct 26 06:44:47 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:44:47 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:44:47 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:44:47 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac733400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3'): ({'sde'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Removing single pathed devices sde {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a824f45a-9c56-418a-bd56-14654ec2323d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[970b7812-aa1c-448d-8cf3-fbe805a82e00]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Flushing IO for device /dev/sde {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab59ce-d372-49d6-b0fd-4c05c5283775]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdf70a6-59ac-4a84-a734-3c57e663cf21]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa9d04f6-52517aecd08f9ab3', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a9d04f6', '/dev/disk/by-id/scsi-23532353137616563') {{(pid=85963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[126903c2-03f9-4816-97b3-081efacd8744]: (4, None) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a05246-6191-40ff-bca1-85d4b4be054b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6284dee6-5f2c-4453-be74-368d2ab5bccb]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260]
Oct 26 06:44:47 user nova-compute[74295]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3, portal: 172.16.0.220,3260] successful.
Oct 26 06:44:47 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e085787-63b6-4668-a1fe-1f4ef8729af3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e43fda-91bf-408d-968e-52181a2ff087]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] <== disconnect_volume: return (332ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:44:47 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Deleting instance files /opt/stack/data/nova/instances/fe7578f8-07ed-4701-9292-9e1d10c5766c_del
Oct 26 06:44:47 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Deletion of /opt/stack/data/nova/instances/fe7578f8-07ed-4701-9292-9e1d10c5766c_del complete
Oct 26 06:44:47 user nova-compute[74295]: INFO nova.compute.manager [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 26 06:44:47 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:48 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:48 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Took 0.75 seconds to deallocate network for instance.
Oct 26 06:44:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e8e7851-c666-42df-bc26-a131f4a3e2c5 req-f897edd2-dc58-4ac4-8109-ac048fee35d7 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e8e7851-c666-42df-bc26-a131f4a3e2c5 req-f897edd2-dc58-4ac4-8109-ac048fee35d7 service nova] Acquiring lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e8e7851-c666-42df-bc26-a131f4a3e2c5 req-f897edd2-dc58-4ac4-8109-ac048fee35d7 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e8e7851-c666-42df-bc26-a131f4a3e2c5 req-f897edd2-dc58-4ac4-8109-ac048fee35d7 service nova] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e8e7851-c666-42df-bc26-a131f4a3e2c5 req-f897edd2-dc58-4ac4-8109-ac048fee35d7 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] No waiting events found dispatching network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:49 user nova-compute[74295]: WARNING nova.compute.manager [req-4e8e7851-c666-42df-bc26-a131f4a3e2c5 req-f897edd2-dc58-4ac4-8109-ac048fee35d7 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received unexpected event network-vif-plugged-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 for instance with vm_state active and task_state deleting.
Oct 26 06:44:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e8e7851-c666-42df-bc26-a131f4a3e2c5 req-f897edd2-dc58-4ac4-8109-ac048fee35d7 service nova] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Received event network-vif-deleted-bc714b43-0ed1-4b49-b1f8-a5eddbf64206 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:49 user nova-compute[74295]: INFO nova.compute.manager [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Took 0.87 seconds to detach 1 volumes for instance.
Oct 26 06:44:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: fe7578f8-07ed-4701-9292-9e1d10c5766c] Deleting volume: 6e085787-63b6-4668-a1fe-1f4ef8729af3 {{(pid=74295) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 06:44:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:49 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:44:49 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:44:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.652s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:50 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Deleted allocations for instance fe7578f8-07ed-4701-9292-9e1d10c5766c
Oct 26 06:44:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-92a4f798-1e41-4fb1-84b9-540c643220a7 tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "fe7578f8-07ed-4701-9292-9e1d10c5766c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.790s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-e4b44920-b06d-4c41-8faa-44282ddf3c42 req-4278db1c-6a73-431a-8246-61c57e8d20b1 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received event network-changed-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-e4b44920-b06d-4c41-8faa-44282ddf3c42 req-4278db1c-6a73-431a-8246-61c57e8d20b1 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Refreshing instance network info cache due to event network-changed-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:44:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e4b44920-b06d-4c41-8faa-44282ddf3c42 req-4278db1c-6a73-431a-8246-61c57e8d20b1 service nova] Acquiring lock "refresh_cache-2a48ac34-3913-482f-91bd-7158c5b1f2bb" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:44:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e4b44920-b06d-4c41-8faa-44282ddf3c42 req-4278db1c-6a73-431a-8246-61c57e8d20b1 service nova] Acquired lock "refresh_cache-2a48ac34-3913-482f-91bd-7158c5b1f2bb" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:44:51 user nova-compute[74295]: DEBUG nova.network.neutron [req-e4b44920-b06d-4c41-8faa-44282ddf3c42 req-4278db1c-6a73-431a-8246-61c57e8d20b1 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Refreshing network info cache for port 5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-e4b44920-b06d-4c41-8faa-44282ddf3c42 req-4278db1c-6a73-431a-8246-61c57e8d20b1 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Updated VIF entry in instance network info cache for port 5d60b5a7-6e0d-466e-9bf9-7c686ad4c241. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-e4b44920-b06d-4c41-8faa-44282ddf3c42 req-4278db1c-6a73-431a-8246-61c57e8d20b1 service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Updating instance_info_cache with network_info: [{"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e4b44920-b06d-4c41-8faa-44282ddf3c42 req-4278db1c-6a73-431a-8246-61c57e8d20b1 service nova] Releasing lock "refresh_cache-2a48ac34-3913-482f-91bd-7158c5b1f2bb" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "b7eba875-99ff-4eff-b2fc-d053c999cac5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:44:52 user nova-compute[74295]: INFO nova.compute.claims [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Claim successful on node user
Oct 26 06:44:53 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:44:53 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:44:53 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG nova.policy [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f8c68bbe2245c6b6f159c45e006216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe63ca1f244085963c38b864dff1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:44:53 user nova-compute[74295]: INFO nova.virt.block_device [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Booting with volume c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 at /dev/vda
Oct 26 06:44:53 user nova-compute[74295]: DEBUG os_brick.utils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ba4a35-ea7e-47ab-8bf8-188e70750615]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ca432d-fa60-4783-9021-629e0fb169bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4747f7d7-c508-4f1b-b376-31184dff8fed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff52d9e-fd79-4bb4-9e5f-016ddf56c3de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:44:53 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:44:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07de0ce-96d2-4a54-a7da-dbea420f0b75]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG os_brick.utils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:44:53 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Updating existing volume attachment record: f6621b75-65e9-4afd-8048-c0e6feb12966 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:44:54 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Successfully created port: 3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:44:54 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Successfully updated port: 3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:44:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-50716c20-874c-443f-bbfc-bceac5c03579 req-b4cdf680-023a-4c2d-901c-c5e14ca8d075 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received event network-changed-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-50716c20-874c-443f-bbfc-bceac5c03579 req-b4cdf680-023a-4c2d-901c-c5e14ca8d075 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Refreshing instance network info cache due to event network-changed-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:44:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-50716c20-874c-443f-bbfc-bceac5c03579 req-b4cdf680-023a-4c2d-901c-c5e14ca8d075 service nova] Acquiring lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:44:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-50716c20-874c-443f-bbfc-bceac5c03579 req-b4cdf680-023a-4c2d-901c-c5e14ca8d075 service nova] Acquired lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:44:54 user nova-compute[74295]: DEBUG nova.network.neutron [req-50716c20-874c-443f-bbfc-bceac5c03579 req-b4cdf680-023a-4c2d-901c-c5e14ca8d075 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Refreshing network info cache for port 3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:44:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:44:54 user nova-compute[74295]: DEBUG nova.network.neutron [req-50716c20-874c-443f-bbfc-bceac5c03579 req-b4cdf680-023a-4c2d-901c-c5e14ca8d075 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:44:55 user nova-compute[74295]: DEBUG nova.network.neutron [req-50716c20-874c-443f-bbfc-bceac5c03579 req-b4cdf680-023a-4c2d-901c-c5e14ca8d075 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-50716c20-874c-443f-bbfc-bceac5c03579 req-b4cdf680-023a-4c2d-901c-c5e14ca8d075 service nova] Releasing lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:44:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquired lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:44:55 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:44:55 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:44:55 user nova-compute[74295]: DEBUG nova.network.neutron [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Updating instance_info_cache with network_info: [{"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Releasing lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:44:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Instance network_info: |[{"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:44:56 user nova-compute[74295]: INFO nova.compute.manager [None req-41cd446b-cd14-49f1-b891-9c727709258d tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Unrescuing
Oct 26 06:44:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-41cd446b-cd14-49f1-b891-9c727709258d tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:44:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-41cd446b-cd14-49f1-b891-9c727709258d tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquired lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:44:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-41cd446b-cd14-49f1-b891-9c727709258d tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:44:56 user nova-compute[74295]: DEBUG nova.network.neutron [None req-41cd446b-cd14-49f1-b891-9c727709258d tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-41cd446b-cd14-49f1-b891-9c727709258d tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Releasing lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:44:56 user nova-compute[74295]: DEBUG nova.objects.instance [None req-41cd446b-cd14-49f1-b891-9c727709258d tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'flavor' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:44:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-8aa31d6d-8b92-4e4e-a560-b73fb40475b9 req-a1429ade-d6ab-4940-867b-520bc47e713f service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-unplugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8aa31d6d-8b92-4e4e-a560-b73fb40475b9 req-a1429ade-d6ab-4940-867b-520bc47e713f service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8aa31d6d-8b92-4e4e-a560-b73fb40475b9 req-a1429ade-d6ab-4940-867b-520bc47e713f service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8aa31d6d-8b92-4e4e-a560-b73fb40475b9 req-a1429ade-d6ab-4940-867b-520bc47e713f service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-8aa31d6d-8b92-4e4e-a560-b73fb40475b9 req-a1429ade-d6ab-4940-867b-520bc47e713f service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-unplugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:57 user nova-compute[74295]: WARNING nova.compute.manager [req-8aa31d6d-8b92-4e4e-a560-b73fb40475b9 req-a1429ade-d6ab-4940-867b-520bc47e713f service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-unplugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:44:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Instance destroyed successfully.
Oct 26 06:44:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-0b3c8d31-c4f8-4adf-b1da-144a9f7bb277 req-fc2f00f1-a32b-45a6-b4c0-8c3d2b48ff14 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-changed-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-0b3c8d31-c4f8-4adf-b1da-144a9f7bb277 req-fc2f00f1-a32b-45a6-b4c0-8c3d2b48ff14 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Refreshing instance network info cache due to event network-changed-5bd6bb7e-c803-4e38-a749-33e26c969d0b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0b3c8d31-c4f8-4adf-b1da-144a9f7bb277 req-fc2f00f1-a32b-45a6-b4c0-8c3d2b48ff14 service nova] Acquiring lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0b3c8d31-c4f8-4adf-b1da-144a9f7bb277 req-fc2f00f1-a32b-45a6-b4c0-8c3d2b48ff14 service nova] Acquired lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG nova.network.neutron [req-0b3c8d31-c4f8-4adf-b1da-144a9f7bb277 req-fc2f00f1-a32b-45a6-b4c0-8c3d2b48ff14 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Refreshing network info cache for port 5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'flavor' on Instance uuid 2a48ac34-3913-482f-91bd-7158c5b1f2bb {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:44:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:58 user nova-compute[74295]: INFO nova.compute.manager [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Attaching volume 13080b4a-7dc3-4d81-af7c-b60e1933c73c to /dev/vdb
Oct 26 06:44:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-0b3c8d31-c4f8-4adf-b1da-144a9f7bb277 req-fc2f00f1-a32b-45a6-b4c0-8c3d2b48ff14 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updated VIF entry in instance network info cache for port 5bd6bb7e-c803-4e38-a749-33e26c969d0b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-0b3c8d31-c4f8-4adf-b1da-144a9f7bb277 req-fc2f00f1-a32b-45a6-b4c0-8c3d2b48ff14 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0b3c8d31-c4f8-4adf-b1da-144a9f7bb277 req-fc2f00f1-a32b-45a6-b4c0-8c3d2b48ff14 service nova] Releasing lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG os_brick.utils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f6b13a-f4a6-40ad-bc9e-23459cd7f67e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91ca7da-3e18-4081-98c1-2d1db48dc8c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "331e2afa-bf70-421f-b26d-ee3067d8aa64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:58 user nova-compute[74295]: INFO nova.compute.manager [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Terminating instance
Oct 26 06:44:58 user nova-compute[74295]: DEBUG nova.compute.manager [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[875304c2-40bc-4cf7-8dcd-e95b6e3fd420]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9343f3-bfc2-42a4-b085-2389401400c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:44:58 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:44:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6f296b-6fe9-485f-9029-1bf71dacfbc9]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG os_brick.utils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Updating existing volume attachment record: f07bed48-d047-4906-885a-eec48b6efd26 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:59 user nova-compute[74295]: WARNING nova.compute.manager [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received event network-vif-unplugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] Acquiring lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] No waiting events found dispatching network-vif-unplugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received event network-vif-unplugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received event network-vif-plugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] Acquiring lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] No waiting events found dispatching network-vif-plugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:44:59 user nova-compute[74295]: WARNING nova.compute.manager [req-24ecee13-3b41-4667-adb6-7311168d1423 req-772b4d83-7909-4524-835d-45a78dc024b6 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received unexpected event network-vif-plugged-f9524efd-4af4-4292-98a1-4ca88442d6b4 for instance with vm_state active and task_state deleting.
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-ef1d7da2-c12f-4bc7-a158-b50c20713aca req-a586fa2a-c6e8-4153-8e85-33dca91dca4c service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-changed-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-ef1d7da2-c12f-4bc7-a158-b50c20713aca req-a586fa2a-c6e8-4153-8e85-33dca91dca4c service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Refreshing instance network info cache due to event network-changed-5bd6bb7e-c803-4e38-a749-33e26c969d0b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ef1d7da2-c12f-4bc7-a158-b50c20713aca req-a586fa2a-c6e8-4153-8e85-33dca91dca4c service nova] Acquiring lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ef1d7da2-c12f-4bc7-a158-b50c20713aca req-a586fa2a-c6e8-4153-8e85-33dca91dca4c service nova] Acquired lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-ef1d7da2-c12f-4bc7-a158-b50c20713aca req-a586fa2a-c6e8-4153-8e85-33dca91dca4c service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Refreshing network info cache for port 5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Instance destroyed successfully.
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.objects.instance [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'resources' on Instance uuid 331e2afa-bf70-421f-b26d-ee3067d8aa64 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-875242491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-875242491',id=22,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-eyq0j1el',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:36:41Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=331e2afa-bf70-421f-b26d-ee3067d8aa64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "address": "fa:16:3e:82:7a:7b", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9524efd-4a", "ovs_interfaceid": "f9524efd-4af4-4292-98a1-4ca88442d6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=f9524efd-4af4-4292-98a1-4ca88442d6b4,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9524efd-4a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG os_vif [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=f9524efd-4af4-4292-98a1-4ca88442d6b4,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9524efd-4a') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9524efd-4a, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60560c2a-a799-4dca-a4ab-6b4ca0d31bba) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:44:59 user nova-compute[74295]: INFO os_vif [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=f9524efd-4af4-4292-98a1-4ca88442d6b4,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9524efd-4a')
Oct 26 06:44:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Deleting instance files /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64_del
Oct 26 06:44:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Deletion of /opt/stack/data/nova/instances/331e2afa-bf70-421f-b26d-ee3067d8aa64_del complete
Oct 26 06:44:59 user nova-compute[74295]: INFO nova.compute.manager [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Took 1.64 seconds to destroy the instance on the hypervisor.
Oct 26 06:44:59 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:44:59 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:45:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-ef1d7da2-c12f-4bc7-a158-b50c20713aca req-a586fa2a-c6e8-4153-8e85-33dca91dca4c service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updated VIF entry in instance network info cache for port 5bd6bb7e-c803-4e38-a749-33e26c969d0b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:45:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-ef1d7da2-c12f-4bc7-a158-b50c20713aca req-a586fa2a-c6e8-4153-8e85-33dca91dca4c service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ef1d7da2-c12f-4bc7-a158-b50c20713aca req-a586fa2a-c6e8-4153-8e85-33dca91dca4c service nova] Releasing lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:45:00 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:00 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Took 0.66 seconds to deallocate network for instance.
Oct 26 06:45:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:00 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:45:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:45:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:01 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Deleted allocations for instance 331e2afa-bf70-421f-b26d-ee3067d8aa64
Oct 26 06:45:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-479dad33-a016-4d1e-9682-c125fcd49661 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "331e2afa-bf70-421f-b26d-ee3067d8aa64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.952s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:01 user nova-compute[74295]: WARNING nova.compute.manager [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:45:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:01 user nova-compute[74295]: WARNING nova.compute.manager [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state rescued and task_state unrescuing.
Oct 26 06:45:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-a46dd15a-a5f2-4e11-ae8c-9cc948fe57ac req-997af855-403f-4429-a808-354458947007 service nova] [instance: 331e2afa-bf70-421f-b26d-ee3067d8aa64] Received event network-vif-deleted-f9524efd-4af4-4292-98a1-4ca88442d6b4 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-41cd446b-cd14-49f1-b891-9c727709258d tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:45:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:13 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:45:13 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:45:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-b0cf078f-eebf-4cae-b1fd-442c74c7b6e4 req-17a9b0ef-2e81-4f58-ab84-41b671e965ad service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:13 user nova-compute[74295]: DEBUG nova.compute.manager [req-b0cf078f-eebf-4cae-b1fd-442c74c7b6e4 req-17a9b0ef-2e81-4f58-ab84-41b671e965ad service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing instance network info cache due to event network-changed-4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:45:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b0cf078f-eebf-4cae-b1fd-442c74c7b6e4 req-17a9b0ef-2e81-4f58-ab84-41b671e965ad service nova] Acquiring lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:45:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b0cf078f-eebf-4cae-b1fd-442c74c7b6e4 req-17a9b0ef-2e81-4f58-ab84-41b671e965ad service nova] Acquired lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:45:13 user nova-compute[74295]: DEBUG nova.network.neutron [req-b0cf078f-eebf-4cae-b1fd-442c74c7b6e4 req-17a9b0ef-2e81-4f58-ab84-41b671e965ad service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Refreshing network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:14 user nova-compute[74295]: INFO nova.compute.manager [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Terminating instance
Oct 26 06:45:14 user nova-compute[74295]: DEBUG nova.compute.manager [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG nova.network.neutron [req-b0cf078f-eebf-4cae-b1fd-442c74c7b6e4 req-17a9b0ef-2e81-4f58-ab84-41b671e965ad service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updated VIF entry in instance network info cache for port 4ecd91eb-3d2e-404b-88f0-1cb61e06732f. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG nova.network.neutron [req-b0cf078f-eebf-4cae-b1fd-442c74c7b6e4 req-17a9b0ef-2e81-4f58-ab84-41b671e965ad service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating instance_info_cache with network_info: [{"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b0cf078f-eebf-4cae-b1fd-442c74c7b6e4 req-17a9b0ef-2e81-4f58-ab84-41b671e965ad service nova] Releasing lock "refresh_cache-c6fb7cff-07da-4441-b992-ec7fee6dd92b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Instance destroyed successfully.
Oct 26 06:45:14 user nova-compute[74295]: DEBUG nova.objects.instance [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lazy-loading 'resources' on Instance uuid c6fb7cff-07da-4441-b992-ec7fee6dd92b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1080291082',display_name='tempest-TestShelveInstance-server-1080291082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1080291082',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHyyG9m2+qncT6D1l6xWi4NskP03lOdp11CJoUdl4QeqjSIivDvMBGZjdN4UqF+ClnuoDFBAyJyYZR2dkI7HjbKWL4pWkBTTPctPMX9xmRxYo8i2qIKW03GWZiibLqVLg==',key_name='tempest-TestShelveInstance-1955889839',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1200573404a43989ba88c780574ffb4',ramdisk_id='',reservation_id='r-wt3jzqse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-930828987',owner_user_name='tempest-TestShelveInstance-930828987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:43:49Z,user_data=None,user_id='030acfa99577474290cf4fe7e3aa7ed2',uuid=c6fb7cff-07da-4441-b992-ec7fee6dd92b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converting VIF {"id": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "address": "fa:16:3e:c9:6e:99", "network": {"id": "701801d6-df2f-44d8-b031-275ac582a787", "bridge": "br-int", "label": "tempest-TestShelveInstance-1330116747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1200573404a43989ba88c780574ffb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ecd91eb-3d", "ovs_interfaceid": "4ecd91eb-3d2e-404b-88f0-1cb61e06732f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_vif [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ecd91eb-3d, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a241c6e3-8834-4d44-b5ef-7c668ff2f486) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:14 user nova-compute[74295]: INFO os_vif [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:6e:99,bridge_name='br-int',has_traffic_filtering=True,id=4ecd91eb-3d2e-404b-88f0-1cb61e06732f,network=Network(701801d6-df2f-44d8-b031-275ac582a787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ecd91eb-3d')
Oct 26 06:45:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuWserJE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:45:14 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d2ac6-e576-42be-af50-989cf1469bfd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:45:14 user nova-compute[74295]: No targets found.
Oct 26 06:45:14 user nova-compute[74295]: iSNS:
Oct 26 06:45:14 user nova-compute[74295]: No targets found.
Oct 26 06:45:14 user nova-compute[74295]: STATIC:
Oct 26 06:45:14 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573
Oct 26 06:45:14 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:14 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:14 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433
Oct 26 06:45:14 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:14 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:14 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:45:14 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:14 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:14 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b
Oct 26 06:45:14 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:14 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:14 user nova-compute[74295]: FIRMWARE:
Oct 26 06:45:14 user nova-compute[74295]: No targets found.
Oct 26 06:45:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:45:14 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:45:14 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8daea74-4ded-4d3f-8dc4-d256f436481b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0215bdb6-f631-45a1-beb3-0badcec2d1b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:14 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:14 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:45:14 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:14 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:14 user nova-compute[74295]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 (non-flash)
Oct 26 06:45:14 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac658b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:45:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcdd872-1436-413b-af8a-e16c4daecf9e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba97e13-29d7-44d1-b944-ae8ebcc83681]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b99bf21-fc8f-401b-a48a-e644ac2f3815]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8de165e-f199-48d0-a0ad-3cdd4bb88f9e]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa3a63583-e76c041ac390a198', '/dev/disk/by-id/scsi-26537366330343161', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a3a63583') {{(pid=85963) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa6b491-015f-44a7-a45b-970ea4b221d5]: (4, None) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c58e8-b4cf-4059-90cb-ef0a757bcce9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f14b028-e1cc-4837-8049-08ffab35133a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260]
Oct 26 06:45:15 user nova-compute[74295]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433, portal: 172.16.0.220,3260] successful.
Oct 26 06:45:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665a14b7-df76-4938-91fb-6a1e1e03a433 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f60834-4beb-4f56-aa59-2b50a6024cee]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] <== disconnect_volume: return (362ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:45:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Deleting instance files /opt/stack/data/nova/instances/c6fb7cff-07da-4441-b992-ec7fee6dd92b_del
Oct 26 06:45:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Deletion of /opt/stack/data/nova/instances/c6fb7cff-07da-4441-b992-ec7fee6dd92b_del complete
Oct 26 06:45:15 user nova-compute[74295]: INFO nova.compute.manager [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:45:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Creating image(s)
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Ensure instance console log exists: /opt/stack/data/nova/instances/b7eba875-99ff-4eff-b2fc-d053c999cac5/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Start _get_guest_xml network_info=[{"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'f6621b75-65e9-4afd-8048-c0e6feb12966', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYIWTpdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7eba875-99ff-4eff-b2fc-d053c999cac5', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0', 'serial': 'c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:45:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:45:15 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYIWTpdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:45:15 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:15 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:15 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3d7e33-acb5-4940-baf1-2bc8e7185e10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:45:15 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[75595428-2fd0-4491-90d0-f0ebb2a65651]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0] added
Oct 26 06:45:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ada15f5-d728-45ad-8d5c-d79b52ed1f88]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a45b05-82f1-411f-8f2e-ab00a38d55e5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYIWTpdD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYIWTpdD" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[068bb994-592e-4360-abdc-bd8ef63c65f9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYIWTpdD'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Took 0.46 seconds to deallocate network for instance.
Oct 26 06:45:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-f5357bf3-dcb6-42aa-bd32-cb7b7fe89d35 req-9e8d8585-65a9-4006-95f7-7b4c6cdfa465 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-deleted-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24e273a-7693-47c8-8945-2f36f11caa47]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[be98a19f-4268-41ea-86a7-6cfe691982e2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:15 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:15 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:15 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:15 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a9a897-a81b-4c66-91f1-ad4d9d80f3d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0, portal: 172.16.0.220,3260]
Oct 26 06:45:15 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0, portal: 172.16.0.220,3260] successful.
Oct 26 06:45:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[806228a5-0aff-4db0-ae26-6545c5896eb9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-unplugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] No waiting events found dispatching network-vif-unplugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-unplugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] Acquiring lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] No waiting events found dispatching network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:16 user nova-compute[74295]: WARNING nova.compute.manager [req-7274344b-3015-4a8a-adc4-8d1b9c34de63 req-18f6e1e7-eed0-4a4f-9891-a0ac516d11b5 service nova] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Received unexpected event network-vif-plugged-4ecd91eb-3d2e-404b-88f0-1cb61e06732f for instance with vm_state active and task_state deleting.
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.133s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc9a14d-47ff-4bef-a226-3b45a47d8a92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:16 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:16 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:16 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:16 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:16 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:16 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:16 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:16 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[072bd7c0-ce18-4bc2-af4a-a88a606129a3]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:45:16 user nova-compute[74295]: INFO nova.compute.manager [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Took 1.04 seconds to detach 1 volumes for instance.
Oct 26 06:45:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] [instance: c6fb7cff-07da-4441-b992-ec7fee6dd92b] Deleting volume: 665a14b7-df76-4938-91fb-6a1e1e03a433 {{(pid=74295) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYIWTpdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '23665633530336561', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665633530336561', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-746117815',display_name='tempest-TestVolumeBootPattern-volume-backed-server-746117815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-746117815',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/GKAc3nWkUbdJ7gZD+lBisak8y61oOZBYy9P2Ye+17oTP2GE3q8LK74wPUPkqtH6b2IDNr7wL8KCgrSkveSErux0mA2tiDVaMXdgA6wQW/oXlEdyNnuTym2j7U9p2Fkw==',key_name='tempest-keypair-896816824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-d80iwpc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:44:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=b7eba875-99ff-4eff-b2fc-d053c999cac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b2:11,bridge_name='br-int',has_traffic_filtering=True,id=3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ceb38a0-cf') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'pci_devices' on Instance uuid b7eba875-99ff-4eff-b2fc-d053c999cac5 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:45:17 user nova-compute[74295]:   <uuid>b7eba875-99ff-4eff-b2fc-d053c999cac5</uuid>
Oct 26 06:45:17 user nova-compute[74295]:   <name>instance-00000023</name>
Oct 26 06:45:17 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:45:17 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:45:17 user nova-compute[74295]:   <metadata>
Oct 26 06:45:17 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:45:17 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:45:17 user nova-compute[74295]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-746117815</nova:name>
Oct 26 06:45:17 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:45:15</nova:creationTime>
Oct 26 06:45:17 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:45:17 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:45:17 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:45:17 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:45:17 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:45:17 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:45:17 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:45:17 user nova-compute[74295]:       <nova:owner>
Oct 26 06:45:17 user nova-compute[74295]:         <nova:user uuid="11f8c68bbe2245c6b6f159c45e006216">tempest-TestVolumeBootPattern-594294549-project-member</nova:user>
Oct 26 06:45:17 user nova-compute[74295]:         <nova:project uuid="75fe63ca1f244085963c38b864dff1db">tempest-TestVolumeBootPattern-594294549</nova:project>
Oct 26 06:45:17 user nova-compute[74295]:       </nova:owner>
Oct 26 06:45:17 user nova-compute[74295]:       <nova:ports>
Oct 26 06:45:17 user nova-compute[74295]:         <nova:port uuid="3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe">
Oct 26 06:45:17 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 06:45:17 user nova-compute[74295]:         </nova:port>
Oct 26 06:45:17 user nova-compute[74295]:       </nova:ports>
Oct 26 06:45:17 user nova-compute[74295]:     </nova:instance>
Oct 26 06:45:17 user nova-compute[74295]:   </metadata>
Oct 26 06:45:17 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:45:17 user nova-compute[74295]:     <system>
Oct 26 06:45:17 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:45:17 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:45:17 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:45:17 user nova-compute[74295]:       <entry name="serial">b7eba875-99ff-4eff-b2fc-d053c999cac5</entry>
Oct 26 06:45:17 user nova-compute[74295]:       <entry name="uuid">b7eba875-99ff-4eff-b2fc-d053c999cac5</entry>
Oct 26 06:45:17 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:45:17 user nova-compute[74295]:     </system>
Oct 26 06:45:17 user nova-compute[74295]:   </sysinfo>
Oct 26 06:45:17 user nova-compute[74295]:   <os>
Oct 26 06:45:17 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:45:17 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:45:17 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:45:17 user nova-compute[74295]:   </os>
Oct 26 06:45:17 user nova-compute[74295]:   <features>
Oct 26 06:45:17 user nova-compute[74295]:     <acpi/>
Oct 26 06:45:17 user nova-compute[74295]:     <apic/>
Oct 26 06:45:17 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:45:17 user nova-compute[74295]:   </features>
Oct 26 06:45:17 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:45:17 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:45:17 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:45:17 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:45:17 user nova-compute[74295]:   </clock>
Oct 26 06:45:17 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:45:17 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:45:17 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:45:17 user nova-compute[74295]:   </cpu>
Oct 26 06:45:17 user nova-compute[74295]:   <devices>
Oct 26 06:45:17 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:45:17 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:45:17 user nova-compute[74295]:       <source dev="/dev/sdc"/>
Oct 26 06:45:17 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:45:17 user nova-compute[74295]:       <serial>c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0</serial>
Oct 26 06:45:17 user nova-compute[74295]:     </disk>
Oct 26 06:45:17 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:45:17 user nova-compute[74295]:       <mac address="fa:16:3e:06:b2:11"/>
Oct 26 06:45:17 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:45:17 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:45:17 user nova-compute[74295]:       <target dev="tap3ceb38a0-cf"/>
Oct 26 06:45:17 user nova-compute[74295]:     </interface>
Oct 26 06:45:17 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:45:17 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/b7eba875-99ff-4eff-b2fc-d053c999cac5/console.log" append="off"/>
Oct 26 06:45:17 user nova-compute[74295]:     </serial>
Oct 26 06:45:17 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:45:17 user nova-compute[74295]:     <video>
Oct 26 06:45:17 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:45:17 user nova-compute[74295]:     </video>
Oct 26 06:45:17 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:45:17 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:45:17 user nova-compute[74295]:     </rng>
Oct 26 06:45:17 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:45:17 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:45:17 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:45:17 user nova-compute[74295]:     </memballoon>
Oct 26 06:45:17 user nova-compute[74295]:   </devices>
Oct 26 06:45:17 user nova-compute[74295]: </domain>
Oct 26 06:45:17 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-746117815',display_name='tempest-TestVolumeBootPattern-volume-backed-server-746117815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-746117815',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/GKAc3nWkUbdJ7gZD+lBisak8y61oOZBYy9P2Ye+17oTP2GE3q8LK74wPUPkqtH6b2IDNr7wL8KCgrSkveSErux0mA2tiDVaMXdgA6wQW/oXlEdyNnuTym2j7U9p2Fkw==',key_name='tempest-keypair-896816824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-d80iwpc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:44:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=b7eba875-99ff-4eff-b2fc-d053c999cac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:b2:11,bridge_name='br-int',has_traffic_filtering=True,id=3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ceb38a0-cf') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG os_vif [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b2:11,bridge_name='br-int',has_traffic_filtering=True,id=3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ceb38a0-cf') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7aefe76-ff12-569e-ad1c-30e08d4abda7', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ceb38a0-cf, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ceb38a0-cf, col_values=(('qos', UUID('6f528bf5-1a3e-427c-a6af-4752b24b65ea')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ceb38a0-cf, col_values=(('external_ids', {'iface-id': '3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:b2:11', 'vm-uuid': 'b7eba875-99ff-4eff-b2fc-d053c999cac5'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:17 user nova-compute[74295]: INFO os_vif [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:b2:11,bridge_name='br-int',has_traffic_filtering=True,id=3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ceb38a0-cf')
Oct 26 06:45:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:17 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Deleted allocations for instance c6fb7cff-07da-4441-b992-ec7fee6dd92b
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No VIF found with MAC fa:16:3e:06:b2:11, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-29279730-8e22-4beb-99bc-b898c2ab6719 tempest-TestShelveInstance-930828987 tempest-TestShelveInstance-930828987-project-member] Lock "c6fb7cff-07da-4441-b992-ec7fee6dd92b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.398s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:45:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:18 user nova-compute[74295]: DEBUG nova.compute.manager [req-6919d242-32f4-4839-8a04-5828b909d9a7 req-09fe5576-08b5-4a27-a08b-ca0067d91635 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received event network-vif-plugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6919d242-32f4-4839-8a04-5828b909d9a7 req-09fe5576-08b5-4a27-a08b-ca0067d91635 service nova] Acquiring lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6919d242-32f4-4839-8a04-5828b909d9a7 req-09fe5576-08b5-4a27-a08b-ca0067d91635 service nova] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6919d242-32f4-4839-8a04-5828b909d9a7 req-09fe5576-08b5-4a27-a08b-ca0067d91635 service nova] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:18 user nova-compute[74295]: DEBUG nova.compute.manager [req-6919d242-32f4-4839-8a04-5828b909d9a7 req-09fe5576-08b5-4a27-a08b-ca0067d91635 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] No waiting events found dispatching network-vif-plugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:18 user nova-compute[74295]: WARNING nova.compute.manager [req-6919d242-32f4-4839-8a04-5828b909d9a7 req-09fe5576-08b5-4a27-a08b-ca0067d91635 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received unexpected event network-vif-plugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe for instance with vm_state building and task_state spawning.
Oct 26 06:45:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:19 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:45:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:45:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:45:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:45:19 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [{"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-1ec0a113-9297-4a51-90fc-83951205185e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:45:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Instance spawned successfully.
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-5f6437b8-fdf0-4b76-85b3-5ce3d649ce62 req-712867af-57a4-4a05-9435-3c488270fcf1 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received event network-vif-plugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5f6437b8-fdf0-4b76-85b3-5ce3d649ce62 req-712867af-57a4-4a05-9435-3c488270fcf1 service nova] Acquiring lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5f6437b8-fdf0-4b76-85b3-5ce3d649ce62 req-712867af-57a4-4a05-9435-3c488270fcf1 service nova] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5f6437b8-fdf0-4b76-85b3-5ce3d649ce62 req-712867af-57a4-4a05-9435-3c488270fcf1 service nova] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-5f6437b8-fdf0-4b76-85b3-5ce3d649ce62 req-712867af-57a4-4a05-9435-3c488270fcf1 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] No waiting events found dispatching network-vif-plugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:20 user nova-compute[74295]: WARNING nova.compute.manager [req-5f6437b8-fdf0-4b76-85b3-5ce3d649ce62 req-712867af-57a4-4a05-9435-3c488270fcf1 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received unexpected event network-vif-plugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe for instance with vm_state building and task_state spawning.
Oct 26 06:45:20 user nova-compute[74295]: INFO nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 26 06:45:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:45:21 user nova-compute[74295]: INFO nova.compute.manager [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Took 28.26 seconds to build instance.
Oct 26 06:45:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c982defe-b0c5-4171-9e6c-3491f9654d23 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.359s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:45:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:45:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8084MB free_disk=25.041309356689453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 1ec0a113-9297-4a51-90fc-83951205185e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b7eba875-99ff-4eff-b2fc-d053c999cac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:45:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:28 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:29 user nova-compute[74295]: INFO nova.compute.manager [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Detaching volume fb3a1533-688b-43ec-be06-8de3836fbf2b
Oct 26 06:45:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCqEPNTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:45:29 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:29 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:29 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[df954f13-8181-4fdf-bb5a-5bb905669c47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:45:29 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf42874-fb8a-40d0-a9a1-16fdb868d393]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c] added
Oct 26 06:45:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: INFO nova.virt.block_device [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Attempting to driver detach volume fb3a1533-688b-43ec-be06-8de3836fbf2b from mountpoint /dev/vdb
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c4b93e-e218-458d-bab6-8e3c9b29d966]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Attempting to detach device vdb from instance 1ec0a113-9297-4a51-90fc-83951205185e from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:45:29 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:45:29 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:45:29 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:45:29 user nova-compute[74295]:   <serial>fb3a1533-688b-43ec-be06-8de3836fbf2b</serial>
Oct 26 06:45:29 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:45:29 user nova-compute[74295]: </disk>
Oct 26 06:45:29 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Successfully detached device vdb from instance 1ec0a113-9297-4a51-90fc-83951205185e from the persistent domain config.
Oct 26 06:45:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ec0a113-9297-4a51-90fc-83951205185e from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:45:29 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:45:29 user nova-compute[74295]:   <source dev="/dev/sdf"/>
Oct 26 06:45:29 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:45:29 user nova-compute[74295]:   <serial>fb3a1533-688b-43ec-be06-8de3836fbf2b</serial>
Oct 26 06:45:29 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:45:29 user nova-compute[74295]: </disk>
Oct 26 06:45:29 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8cd8d1-931a-4261-939d-44de917e11c5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCqEPNTj {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCqEPNTj" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[141992ef-ce68-485d-b7ef-f5119ae03c77]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VCqEPNTj'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[687ddc42-bc39-4bf0-9b92-baf5e1cad3c1]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d998756-f77e-4ec4-91fe-a50121708681]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c79c43-85c6-425d-adbd-f839285d73f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c, portal: 172.16.0.220,3260]
Oct 26 06:45:29 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c, portal: 172.16.0.220,3260] successful.
Oct 26 06:45:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8292b2-9bd0-467f-99f6-3d855732905d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf2c285-badb-4da6-a2c4-bc532fc07322]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)
Oct 26 06:45:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:29 user nova-compute[74295]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)
Oct 26 06:45:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8b87ee-576a-4221-aa4d-3ab1cf388865]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:45:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCqEPNTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:45:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:45:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23063316564363164', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:45:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063316564363164', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:45:30 user nova-compute[74295]: DEBUG nova.objects.instance [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'flavor' on Instance uuid 2a48ac34-3913-482f-91bd-7158c5b1f2bb {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:45:31 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:45:31 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:45:31 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:45:31 user nova-compute[74295]:   <serial>13080b4a-7dc3-4d81-af7c-b60e1933c73c</serial>
Oct 26 06:45:31 user nova-compute[74295]: </disk>
Oct 26 06:45:31 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:45:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:45:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:45:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] No VIF found with MAC fa:16:3e:77:41:2e, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:45:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-249be15e-b98e-4aa0-841e-db4e01457473 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.580s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:32 user nova-compute[74295]: INFO nova.compute.manager [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Detaching volume 13080b4a-7dc3-4d81-af7c-b60e1933c73c
Oct 26 06:45:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:32 user nova-compute[74295]: INFO nova.virt.block_device [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Attempting to driver detach volume 13080b4a-7dc3-4d81-af7c-b60e1933c73c from mountpoint /dev/vdb
Oct 26 06:45:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Attempting to detach device vdb from instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:45:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:45:32 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:45:32 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:45:32 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:45:32 user nova-compute[74295]:   <serial>13080b4a-7dc3-4d81-af7c-b60e1933c73c</serial>
Oct 26 06:45:32 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:45:32 user nova-compute[74295]: </disk>
Oct 26 06:45:32 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:45:32 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully detached device vdb from instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb from the persistent domain config.
Oct 26 06:45:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:45:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:45:32 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:45:32 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:45:32 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:45:32 user nova-compute[74295]:   <serial>13080b4a-7dc3-4d81-af7c-b60e1933c73c</serial>
Oct 26 06:45:32 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:45:32 user nova-compute[74295]: </disk>
Oct 26 06:45:32 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:45:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:45:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:48 user nova-compute[74295]: INFO nova.compute.manager [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Terminating instance
Oct 26 06:45:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:45:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-cbe06152-24f6-4a33-99f5-980605685cd8 req-94ba36bf-d806-4a98-b7f4-197e89bc4345 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-unplugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cbe06152-24f6-4a33-99f5-980605685cd8 req-94ba36bf-d806-4a98-b7f4-197e89bc4345 service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cbe06152-24f6-4a33-99f5-980605685cd8 req-94ba36bf-d806-4a98-b7f4-197e89bc4345 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cbe06152-24f6-4a33-99f5-980605685cd8 req-94ba36bf-d806-4a98-b7f4-197e89bc4345 service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-cbe06152-24f6-4a33-99f5-980605685cd8 req-94ba36bf-d806-4a98-b7f4-197e89bc4345 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-unplugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-cbe06152-24f6-4a33-99f5-980605685cd8 req-94ba36bf-d806-4a98-b7f4-197e89bc4345 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-unplugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:49 user nova-compute[74295]: INFO nova.compute.manager [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Terminating instance
Oct 26 06:45:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Instance destroyed successfully.
Oct 26 06:45:49 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'resources' on Instance uuid 563360ea-d5ca-4006-9c23-3bf9aac300ce {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1188557978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1188557978',id=12,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-gak5wurj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:32:57Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=563360ea-d5ca-4006-9c23-3bf9aac300ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "985646da-fc56-4732-901c-7d0dfd148f33", "address": "fa:16:3e:c8:c8:ae", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap985646da-fc", "ovs_interfaceid": "985646da-fc56-4732-901c-7d0dfd148f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:c8:ae,bridge_name='br-int',has_traffic_filtering=True,id=985646da-fc56-4732-901c-7d0dfd148f33,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985646da-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_vif [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:c8:ae,bridge_name='br-int',has_traffic_filtering=True,id=985646da-fc56-4732-901c-7d0dfd148f33,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985646da-fc') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap985646da-fc, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65f6b3d3-cb4b-4142-b7ff-ca6c9213754d) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:49 user nova-compute[74295]: INFO os_vif [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:c8:ae,bridge_name='br-int',has_traffic_filtering=True,id=985646da-fc56-4732-901c-7d0dfd148f33,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap985646da-fc')
Oct 26 06:45:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScNZWuHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:45:49 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5bb965-7e05-4030-a672-7ec5d2586d43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:45:49 user nova-compute[74295]: No targets found.
Oct 26 06:45:49 user nova-compute[74295]: iSNS:
Oct 26 06:45:49 user nova-compute[74295]: No targets found.
Oct 26 06:45:49 user nova-compute[74295]: STATIC:
Oct 26 06:45:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573
Oct 26 06:45:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0
Oct 26 06:45:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c
Oct 26 06:45:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066
Oct 26 06:45:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b
Oct 26 06:45:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:49 user nova-compute[74295]: FIRMWARE:
Oct 26 06:45:49 user nova-compute[74295]: No targets found.
Oct 26 06:45:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:45:49 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:45:49 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fb57b1-b04a-404e-9800-cd15b759064b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33c4519-d2a0-42be-b428-e63e91eb5cb3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:49 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:49 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:49 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:49 user nova-compute[74295]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)
Oct 26 06:45:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 (non-flash)
Oct 26 06:45:49 user nova-compute[74295]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:49 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:49 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:49 user nova-compute[74295]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)
Oct 26 06:45:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac25c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc9adb-b4fb-479d-9324-a17742770d3a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67abb39-d0ef-4654-bb55-68f10c13dd04]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8a15dd-a2fe-4b12-a457-71a81117196b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.128s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1077578-967a-470c-aa90-d0ae110b674f]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Instance destroyed successfully.
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.objects.instance [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lazy-loading 'resources' on Instance uuid 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1740260226',display_name='tempest-ServerActionsTestOtherA-server-1740260226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1740260226',id=6,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEalUstBq4vFH7qnNchfBeKikF9/lcUlFw9j5QYSoSoqdNDpcgRH/nIAEmyjwdsmFPjVTLPazAWFfDhK1wvnJyZTilappqjUYF52/w6x/BiOg104d9g3zNtJX38DMWLdw==',key_name='tempest-keypair-977042820',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b6035868e347c4b90651f3ad73237a',ramdisk_id='',reservation_id='r-8axglv5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-911482981',owner_user_name='tempest-ServerActionsTestOtherA-911482981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:26:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c3d6fa25d143bc935e7e16275aac57',uuid=4258d8a5-3e8b-4a4d-8ca6-420ece04e598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converting VIF {"id": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "address": "fa:16:3e:e0:e7:bf", "network": {"id": "6cce1a0e-e1f0-4d57-9616-f6064ed4b82c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-131214272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b6035868e347c4b90651f3ad73237a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f426b1f-4f", "ovs_interfaceid": "6f426b1f-4f0b-43d7-aea7-6a6c3e130773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e7:bf,bridge_name='br-int',has_traffic_filtering=True,id=6f426b1f-4f0b-43d7-aea7-6a6c3e130773,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f426b1f-4f') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_vif [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e7:bf,bridge_name='br-int',has_traffic_filtering=True,id=6f426b1f-4f0b-43d7-aea7-6a6c3e130773,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f426b1f-4f') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f426b1f-4f, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:50 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ec0a113-9297-4a51-90fc-83951205185e is timed out.
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a5038e-4104-4e70-872e-ba0f8fe973f4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Successfully detached device vdb from instance 1ec0a113-9297-4a51-90fc-83951205185e from the live domain config.
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NQjZuhbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:45:50 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d87c9e0-cfa9-447a-af44-99ffd1c4ebf6) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:50 user nova-compute[74295]: INFO os_vif [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e7:bf,bridge_name='br-int',has_traffic_filtering=True,id=6f426b1f-4f0b-43d7-aea7-6a6c3e130773,network=Network(6cce1a0e-e1f0-4d57-9616-f6064ed4b82c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f426b1f-4f')
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Deleting instance files /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598_del
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Deletion of /opt/stack/data/nova/instances/4258d8a5-3e8b-4a4d-8ca6-420ece04e598_del complete
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2032700c-29d1-48e8-bb79-428da2042b98]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066, portal: 172.16.0.220,3260]
Oct 26 06:45:50 user nova-compute[74295]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066, portal: 172.16.0.220,3260] successful.
Oct 26 06:45:50 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ce315e-d746-48e0-ae4d-0bdd50f92066 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[981b0fd3-3e6f-4c44-9595-ff92415b7f06]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] <== disconnect_volume: return (475ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Deleting instance files /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce_del
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Deletion of /opt/stack/data/nova/instances/563360ea-d5ca-4006-9c23-3bf9aac300ce_del complete
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.118s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.compute.manager [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d4247c-a99d-4690-863d-cdb076371da5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:45:50 user nova-compute[74295]: No targets found.
Oct 26 06:45:50 user nova-compute[74295]: iSNS:
Oct 26 06:45:50 user nova-compute[74295]: No targets found.
Oct 26 06:45:50 user nova-compute[74295]: STATIC:
Oct 26 06:45:50 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573
Oct 26 06:45:50 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:50 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:50 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0
Oct 26 06:45:50 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:50 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:50 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c
Oct 26 06:45:50 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:50 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:50 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b
Oct 26 06:45:50 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:50 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:50 user nova-compute[74295]: FIRMWARE:
Oct 26 06:45:50 user nova-compute[74295]: No targets found.
Oct 26 06:45:50 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:45:50 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:45:50 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbb7903-5ff1-42c0-8cb2-b0deb8aa7212]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.compute.manager [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Took 1.53 seconds to destroy the instance on the hypervisor.
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3360ce65-97e6-4f26-a256-7028b3fa9c7d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:50 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:50 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:50 user nova-compute[74295]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)
Oct 26 06:45:50 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b (non-flash)
Oct 26 06:45:50 user nova-compute[74295]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:50 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:50 user nova-compute[74295]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)
Oct 26 06:45:50 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3588799480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b'): ({'sdf'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Removing single pathed devices sdf {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[333c330c-c30e-43e3-8919-9c87b03e53ad]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47d1f77-3e46-4e3d-afd6-fed851ae7d13]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Flushing IO for device /dev/sdf {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc6163d-05a2-4698-9f23-efb3a43348f1]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd0e638-46dd-4b96-9e91-2d9b43c56c8c]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] SCSI volumes sdf have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f599d30-8594-4325-ab96-392aea4c665c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32be736-bc67-461c-9b43-d870df2cc25c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b, portal: 172.16.0.220,3260]
Oct 26 06:45:50 user nova-compute[74295]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b, portal: 172.16.0.220,3260] successful.
Oct 26 06:45:50 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3a1533-688b-43ec-be06-8de3836fbf2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec5ad4e-9553-434a-8b0f-a4bc812aca20]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] <== disconnect_volume: return (469ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Took 0.52 seconds to deallocate network for instance.
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-37dab8ec-3174-4828-a48e-364583389000 req-298da261-43db-4b55-aa1a-7bfdfd2bcb4e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received event network-vif-deleted-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:50 user nova-compute[74295]: INFO nova.compute.manager [req-37dab8ec-3174-4828-a48e-364583389000 req-298da261-43db-4b55-aa1a-7bfdfd2bcb4e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Neutron deleted interface 6f426b1f-4f0b-43d7-aea7-6a6c3e130773; detaching it from the instance and deleting it from the info cache
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.network.neutron [req-37dab8ec-3174-4828-a48e-364583389000 req-298da261-43db-4b55-aa1a-7bfdfd2bcb4e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-37dab8ec-3174-4828-a48e-364583389000 req-298da261-43db-4b55-aa1a-7bfdfd2bcb4e service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Detach interface failed, port_id=6f426b1f-4f0b-43d7-aea7-6a6c3e130773, reason: Instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:51 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Took 0.79 seconds to deallocate network for instance.
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-948831c4-22cb-45fb-a6b3-3c33138aa0dd req-5d4c7ab4-16fd-4cbb-8318-8a44f427c314 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-deleted-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:51 user nova-compute[74295]: INFO nova.compute.manager [req-948831c4-22cb-45fb-a6b3-3c33138aa0dd req-5d4c7ab4-16fd-4cbb-8318-8a44f427c314 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Neutron deleted interface 985646da-fc56-4732-901c-7d0dfd148f33; detaching it from the instance and deleting it from the info cache
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.network.neutron [req-948831c4-22cb-45fb-a6b3-3c33138aa0dd req-5d4c7ab4-16fd-4cbb-8318-8a44f427c314 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-948831c4-22cb-45fb-a6b3-3c33138aa0dd req-5d4c7ab4-16fd-4cbb-8318-8a44f427c314 service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Detach interface failed, port_id=985646da-fc56-4732-901c-7d0dfd148f33, reason: Instance 563360ea-d5ca-4006-9c23-3bf9aac300ce could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] Acquiring lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] No waiting events found dispatching network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:51 user nova-compute[74295]: WARNING nova.compute.manager [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Received unexpected event network-vif-plugged-985646da-fc56-4732-901c-7d0dfd148f33 for instance with vm_state active and task_state deleting.
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received event network-vif-unplugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] Acquiring lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] No waiting events found dispatching network-vif-unplugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:51 user nova-compute[74295]: WARNING nova.compute.manager [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received unexpected event network-vif-unplugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 for instance with vm_state deleted and task_state None.
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received event network-vif-plugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] Acquiring lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] No waiting events found dispatching network-vif-plugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:51 user nova-compute[74295]: WARNING nova.compute.manager [req-6525705e-bf6f-4856-8ec7-15bac0b2e743 req-c362f1da-d6bb-4623-90fa-92d7903035eb service nova] [instance: 4258d8a5-3e8b-4a4d-8ca6-420ece04e598] Received unexpected event network-vif-plugged-6f426b1f-4f0b-43d7-aea7-6a6c3e130773 for instance with vm_state deleted and task_state None.
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:51 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Deleted allocations for instance 4258d8a5-3e8b-4a4d-8ca6-420ece04e598
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ed5ba002-dea1-46d7-83aa-e0c7a0d4a04d tempest-ServerActionsTestOtherA-911482981 tempest-ServerActionsTestOtherA-911482981-project-member] Lock "4258d8a5-3e8b-4a4d-8ca6-420ece04e598" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'flavor' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f0ac024f-573c-4dea-aa60-140081424336 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.313s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:52 user nova-compute[74295]: INFO nova.compute.manager [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: 563360ea-d5ca-4006-9c23-3bf9aac300ce] Took 0.87 seconds to detach 1 volumes for instance.
Oct 26 06:45:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:52 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:45:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:52 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:45:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:52 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Deleted allocations for instance 563360ea-d5ca-4006-9c23-3bf9aac300ce
Oct 26 06:45:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c933c284-7469-499e-acef-47ed56138e77 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "563360ea-d5ca-4006-9c23-3bf9aac300ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.890s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:53 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb is timed out.
Oct 26 06:45:53 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully detached device vdb from instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb from the live domain config.
Oct 26 06:45:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCqEPNTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:45:53 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb58c03-e702-49a7-96b2-0708975c7e65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:45:53 user nova-compute[74295]: No targets found.
Oct 26 06:45:53 user nova-compute[74295]: iSNS:
Oct 26 06:45:53 user nova-compute[74295]: No targets found.
Oct 26 06:45:53 user nova-compute[74295]: STATIC:
Oct 26 06:45:53 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573
Oct 26 06:45:53 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:53 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:53 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0
Oct 26 06:45:53 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:53 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:53 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c
Oct 26 06:45:53 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:53 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:53 user nova-compute[74295]: FIRMWARE:
Oct 26 06:45:53 user nova-compute[74295]: No targets found.
Oct 26 06:45:53 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:45:53 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:45:53 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc114546-2aaf-42e6-ad3a-f347157a6421]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fd9e5c-7013-456c-b8f6-2e77084d13ff]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:53 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:53 user nova-compute[74295]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)
Oct 26 06:45:53 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:53 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:53 user nova-compute[74295]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c (non-flash)
Oct 26 06:45:53 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac507e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f1757-7c76-4aeb-8176-cd92d4205acd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb27158-b833-4dd4-87ae-ea05b18e54c3]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dac1e0-8e73-4b25-a74a-21363f9efa9e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa21f0-ab60-4826-8481-84c007d66ca5]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c509f31-6a20-4dde-af19-3935ce848c0d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fcc3c4-a83e-4080-8b22-0f92178ff94d]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c, portal: 172.16.0.220,3260]
Oct 26 06:45:53 user nova-compute[74295]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c, portal: 172.16.0.220,3260] successful.
Oct 26 06:45:53 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13080b4a-7dc3-4d81-af7c-b60e1933c73c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec08b38-6f86-40bf-bea5-a62328c505f8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] <== disconnect_volume: return (283ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:45:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:45:54 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'flavor' on Instance uuid 2a48ac34-3913-482f-91bd-7158c5b1f2bb {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c5ca0d1-891d-419a-9223-a3139051b1bb tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:54 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:45:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquired lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:45:54 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:45:54 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'info_cache' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:54 user nova-compute[74295]: DEBUG nova.objects.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updating instance_info_cache with network_info: [{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Releasing lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:45:55 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance destroyed successfully.
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'resources' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.objects.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1591415229',display_name='tempest-AttachVolumeTestJSON-server-1591415229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1591415229',id=33,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7JNBP8TyOuHsG10l/IfSBEWSkkEP86O+W7m1eIwVlzmm7l/gSpZcL5vTicjil3gUPq4t2iOoKKXCyzOLUfkbOoS1QhygvZVkpBJuD4Uq8O5dAEL94jKzDS+1L+rw6ypA==',key_name='tempest-keypair-1584679424',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-io9ajpiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=d05fad65-dd3a-4a04-8b42-f81313c4aca4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_vif [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4dc83bc-fc, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d82e1e6e-9e46-4cdb-bc91-b202807fd556) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:55 user nova-compute[74295]: INFO os_vif [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc')
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwBYQqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:45:55 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebf6133-5d4d-4f80-b2c5-4320ce11e578]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:45:55 user nova-compute[74295]: No targets found.
Oct 26 06:45:55 user nova-compute[74295]: iSNS:
Oct 26 06:45:55 user nova-compute[74295]: No targets found.
Oct 26 06:45:55 user nova-compute[74295]: STATIC:
Oct 26 06:45:55 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573
Oct 26 06:45:55 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:55 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:55 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0
Oct 26 06:45:55 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:45:55 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:45:55 user nova-compute[74295]: FIRMWARE:
Oct 26 06:45:55 user nova-compute[74295]: No targets found.
Oct 26 06:45:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:45:55 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:45:55 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[068990c9-73ce-4726-9907-95e50bb34f2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e51b423-df01-497b-92ca-7d8592407c7d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:55 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:55 user nova-compute[74295]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac568b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573'): ({'sdg'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Removing single pathed devices sdg {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf69ab1e-dacf-484e-a6ce-80b572f01eb5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[36aeb1f3-de3b-4706-a7ad-faaa06a99c3d]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flushing IO for device /dev/sdg {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c480ac-ac02-44ce-b1b1-15f3c35be22c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a2aada-40fe-49b6-ac1d-6c92fe088200]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] SCSI volumes sdg have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f3450-68b0-492b-aeed-b57c9b658765]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17c7562-60c6-4cb4-b059-88f80c0ff786]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260]
Oct 26 06:45:55 user nova-compute[74295]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260] successful.
Oct 26 06:45:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dc8f1d-a1dd-4889-94c2-223d45c8e65e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== disconnect_volume: return (302ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Start _get_guest_xml network_info=[{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'b1b803e0-0cba-48b6-9e87-86ba5e51ac6d', 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwBYQqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'd05fad65-dd3a-4a04-8b42-f81313c4aca4', 'attached_at': '', 'detached_at': '', 'volume_id': '4a02d39a-927a-46ec-ae89-f307ce4d5573', 'serial': '4a02d39a-927a-46ec-ae89-f307ce4d5573'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'numa_topology' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.objects.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:45:55 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:45:55 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'vcpu_model' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.objects.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwBYQqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:45:55 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:55 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:45:55 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6cb703-070d-4c65-91c9-1bfd7533d74f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:45:55 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec925828-216d-4ba1-8651-dabc02cd126d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573] added
Oct 26 06:45:55 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[405b91ca-2ff4-4253-88cc-38d88fa6ee67]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf41d2b-dc13-40bc-8749-783a548d531a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwBYQqST {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwBYQqST" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:55 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a697d97-a3c0-4bfc-ba6e-a948d8c8747c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwBYQqST'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d89d04d-bded-44fd-a3c7-53de82a30609]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a705e863-f84e-49c5-a5c6-1ba28a0ee550]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7a54b2-f8cc-4fcc-95f1-3f8cd5641c92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260]
Oct 26 06:45:56 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260] successful.
Oct 26 06:45:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4e9c3f-ef8c-4129-900e-88bfade96728]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[172c0ae0-9607-4470-a5b9-431a0d55b22a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:56 user nova-compute[74295]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:45:56 user nova-compute[74295]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:45:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0363d-c5ec-4c53-9341-6c5c86583a41]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:45:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwBYQqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23363323934346438', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363323934346438', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1591415229',display_name='tempest-AttachVolumeTestJSON-server-1591415229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1591415229',id=33,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7JNBP8TyOuHsG10l/IfSBEWSkkEP86O+W7m1eIwVlzmm7l/gSpZcL5vTicjil3gUPq4t2iOoKKXCyzOLUfkbOoS1QhygvZVkpBJuD4Uq8O5dAEL94jKzDS+1L+rw6ypA==',key_name='tempest-keypair-1584679424',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-io9ajpiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=d05fad65-dd3a-4a04-8b42-f81313c4aca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'pci_devices' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.objects.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:45:57 user nova-compute[74295]:   <uuid>d05fad65-dd3a-4a04-8b42-f81313c4aca4</uuid>
Oct 26 06:45:57 user nova-compute[74295]:   <name>instance-00000021</name>
Oct 26 06:45:57 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:45:57 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:45:57 user nova-compute[74295]:   <metadata>
Oct 26 06:45:57 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:45:57 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:45:57 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeTestJSON-server-1591415229</nova:name>
Oct 26 06:45:57 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:45:55</nova:creationTime>
Oct 26 06:45:57 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:45:57 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:45:57 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:45:57 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:45:57 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:45:57 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:45:57 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:45:57 user nova-compute[74295]:       <nova:owner>
Oct 26 06:45:57 user nova-compute[74295]:         <nova:user uuid="7c0aa0cb8a174036bb890dca38df6e7d">tempest-AttachVolumeTestJSON-93311543-project-member</nova:user>
Oct 26 06:45:57 user nova-compute[74295]:         <nova:project uuid="b5f36efc5cdc4cf5a61b0807a1235ba4">tempest-AttachVolumeTestJSON-93311543</nova:project>
Oct 26 06:45:57 user nova-compute[74295]:       </nova:owner>
Oct 26 06:45:57 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:45:57 user nova-compute[74295]:       <nova:ports>
Oct 26 06:45:57 user nova-compute[74295]:         <nova:port uuid="f4dc83bc-fc9b-437c-a72c-e3f765165204">
Oct 26 06:45:57 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 06:45:57 user nova-compute[74295]:         </nova:port>
Oct 26 06:45:57 user nova-compute[74295]:       </nova:ports>
Oct 26 06:45:57 user nova-compute[74295]:     </nova:instance>
Oct 26 06:45:57 user nova-compute[74295]:   </metadata>
Oct 26 06:45:57 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:45:57 user nova-compute[74295]:     <system>
Oct 26 06:45:57 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:45:57 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:45:57 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:45:57 user nova-compute[74295]:       <entry name="serial">d05fad65-dd3a-4a04-8b42-f81313c4aca4</entry>
Oct 26 06:45:57 user nova-compute[74295]:       <entry name="uuid">d05fad65-dd3a-4a04-8b42-f81313c4aca4</entry>
Oct 26 06:45:57 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:45:57 user nova-compute[74295]:     </system>
Oct 26 06:45:57 user nova-compute[74295]:   </sysinfo>
Oct 26 06:45:57 user nova-compute[74295]:   <os>
Oct 26 06:45:57 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:45:57 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:45:57 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:45:57 user nova-compute[74295]:   </os>
Oct 26 06:45:57 user nova-compute[74295]:   <features>
Oct 26 06:45:57 user nova-compute[74295]:     <acpi/>
Oct 26 06:45:57 user nova-compute[74295]:     <apic/>
Oct 26 06:45:57 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:45:57 user nova-compute[74295]:   </features>
Oct 26 06:45:57 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:45:57 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:45:57 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:45:57 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:45:57 user nova-compute[74295]:   </clock>
Oct 26 06:45:57 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:45:57 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:45:57 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:45:57 user nova-compute[74295]:   </cpu>
Oct 26 06:45:57 user nova-compute[74295]:   <devices>
Oct 26 06:45:57 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:45:57 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:45:57 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk"/>
Oct 26 06:45:57 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:45:57 user nova-compute[74295]:     </disk>
Oct 26 06:45:57 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:45:57 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:45:57 user nova-compute[74295]:       <source dev="/dev/sdb"/>
Oct 26 06:45:57 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 06:45:57 user nova-compute[74295]:       <serial>4a02d39a-927a-46ec-ae89-f307ce4d5573</serial>
Oct 26 06:45:57 user nova-compute[74295]:     </disk>
Oct 26 06:45:57 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:45:57 user nova-compute[74295]:       <mac address="fa:16:3e:ba:0d:a5"/>
Oct 26 06:45:57 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:45:57 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:45:57 user nova-compute[74295]:       <target dev="tapf4dc83bc-fc"/>
Oct 26 06:45:57 user nova-compute[74295]:     </interface>
Oct 26 06:45:57 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:45:57 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/console.log" append="off"/>
Oct 26 06:45:57 user nova-compute[74295]:     </serial>
Oct 26 06:45:57 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:45:57 user nova-compute[74295]:     <video>
Oct 26 06:45:57 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:45:57 user nova-compute[74295]:     </video>
Oct 26 06:45:57 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:45:57 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:45:57 user nova-compute[74295]:     </rng>
Oct 26 06:45:57 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:45:57 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:45:57 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:45:57 user nova-compute[74295]:     </memballoon>
Oct 26 06:45:57 user nova-compute[74295]:   </devices>
Oct 26 06:45:57 user nova-compute[74295]: </domain>
Oct 26 06:45:57 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'trusted_certs' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.objects.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:45:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Cannot resize image /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'migration_context' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG nova.objects.base [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1591415229',display_name='tempest-AttachVolumeTestJSON-server-1591415229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1591415229',id=33,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7JNBP8TyOuHsG10l/IfSBEWSkkEP86O+W7m1eIwVlzmm7l/gSpZcL5vTicjil3gUPq4t2iOoKKXCyzOLUfkbOoS1QhygvZVkpBJuD4Uq8O5dAEL94jKzDS+1L+rw6ypA==',key_name='tempest-keypair-1584679424',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-io9ajpiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=d05fad65-dd3a-4a04-8b42-f81313c4aca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG os_vif [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dbc58bd-f29a-5a04-adee-e1f09d442357', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4dc83bc-fc, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4dc83bc-fc, col_values=(('qos', UUID('c61355d1-856a-4705-afaf-a5e14198434a')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4dc83bc-fc, col_values=(('external_ids', {'iface-id': 'f4dc83bc-fc9b-437c-a72c-e3f765165204', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:0d:a5', 'vm-uuid': 'd05fad65-dd3a-4a04-8b42-f81313c4aca4'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:45:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:58 user nova-compute[74295]: INFO os_vif [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc')
Oct 26 06:45:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:45:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-b9edaa92-7be1-490f-bc4a-fdca83efa0fe req-6d448a4f-79d4-41a7-b1d2-f40da506f48b service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:45:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b9edaa92-7be1-490f-bc4a-fdca83efa0fe req-6d448a4f-79d4-41a7-b1d2-f40da506f48b service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:45:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b9edaa92-7be1-490f-bc4a-fdca83efa0fe req-6d448a4f-79d4-41a7-b1d2-f40da506f48b service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:45:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b9edaa92-7be1-490f-bc4a-fdca83efa0fe req-6d448a4f-79d4-41a7-b1d2-f40da506f48b service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:45:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-b9edaa92-7be1-490f-bc4a-fdca83efa0fe req-6d448a4f-79d4-41a7-b1d2-f40da506f48b service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:45:59 user nova-compute[74295]: WARNING nova.compute.manager [req-b9edaa92-7be1-490f-bc4a-fdca83efa0fe req-6d448a4f-79d4-41a7-b1d2-f40da506f48b service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state stopped and task_state powering-on.
Oct 26 06:46:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:46:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance rebooted successfully.
Oct 26 06:46:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e045b4bd-4340-402c-a741-0a9378d4faa3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:46:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e6314b3-5469-40a1-a1d9-c9b8ead764fc req-f1eaa47d-b2e0-445a-a740-d644e42ef8e5 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e6314b3-5469-40a1-a1d9-c9b8ead764fc req-f1eaa47d-b2e0-445a-a740-d644e42ef8e5 service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e6314b3-5469-40a1-a1d9-c9b8ead764fc req-f1eaa47d-b2e0-445a-a740-d644e42ef8e5 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4e6314b3-5469-40a1-a1d9-c9b8ead764fc req-f1eaa47d-b2e0-445a-a740-d644e42ef8e5 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-4e6314b3-5469-40a1-a1d9-c9b8ead764fc req-f1eaa47d-b2e0-445a-a740-d644e42ef8e5 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:01 user nova-compute[74295]: WARNING nova.compute.manager [req-4e6314b3-5469-40a1-a1d9-c9b8ead764fc req-f1eaa47d-b2e0-445a-a740-d644e42ef8e5 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state stopped and task_state powering-on.
Oct 26 06:46:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:18 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:46:19 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:19 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:46:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:20 user nova-compute[74295]: INFO nova.compute.manager [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Terminating instance
Oct 26 06:46:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-db9dbb39-460f-4586-bc43-6da54c5bf4bd req-8b7ef18c-b876-45be-a299-2b52accecdec service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-unplugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-db9dbb39-460f-4586-bc43-6da54c5bf4bd req-8b7ef18c-b876-45be-a299-2b52accecdec service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-db9dbb39-460f-4586-bc43-6da54c5bf4bd req-8b7ef18c-b876-45be-a299-2b52accecdec service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-db9dbb39-460f-4586-bc43-6da54c5bf4bd req-8b7ef18c-b876-45be-a299-2b52accecdec service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-db9dbb39-460f-4586-bc43-6da54c5bf4bd req-8b7ef18c-b876-45be-a299-2b52accecdec service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-unplugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-db9dbb39-460f-4586-bc43-6da54c5bf4bd req-8b7ef18c-b876-45be-a299-2b52accecdec service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-unplugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Instance destroyed successfully.
Oct 26 06:46:21 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lazy-loading 'resources' on Instance uuid 1ec0a113-9297-4a51-90fc-83951205185e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1392926511',display_name='tempest-ServerStableDeviceRescueTest-server-1392926511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1392926511',id=29,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCldV0yuPoQiiDXH44VGXoIgKqgvSFBi6Hv9K7jeKgrzhKDrWQR5W3znD5kBdw6Jn+iX1rsymZxq81sNyNyQoFsCfnt2hU1HDWcY+plStJw6Cx9OHXS9dITlQF2ADPEWhg==',key_name='tempest-keypair-1336098653',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:43:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='667a324e48fd4a0e805b6abeaaf4e042',ramdisk_id='',reservation_id='r-118ruu2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-978011123',owner_user_name='tempest-ServerStableDeviceRescueTest-978011123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78a41a82ce944e3292053de4cfb9f770',uuid=1ec0a113-9297-4a51-90fc-83951205185e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Converting VIF {"id": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "address": "fa:16:3e:dd:71:e8", "network": {"id": "3f2414db-1d72-4464-a566-e13dc6cc475c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-743370702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "667a324e48fd4a0e805b6abeaaf4e042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd6bb7e-c8", "ovs_interfaceid": "5bd6bb7e-c803-4e38-a749-33e26c969d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:71:e8,bridge_name='br-int',has_traffic_filtering=True,id=5bd6bb7e-c803-4e38-a749-33e26c969d0b,network=Network(3f2414db-1d72-4464-a566-e13dc6cc475c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd6bb7e-c8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG os_vif [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:71:e8,bridge_name='br-int',has_traffic_filtering=True,id=5bd6bb7e-c803-4e38-a749-33e26c969d0b,network=Network(3f2414db-1d72-4464-a566-e13dc6cc475c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd6bb7e-c8') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bd6bb7e-c8, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e39aaf1-6555-4bb7-8be6-bf539b64e8b3) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:21 user nova-compute[74295]: INFO os_vif [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:71:e8,bridge_name='br-int',has_traffic_filtering=True,id=5bd6bb7e-c803-4e38-a749-33e26c969d0b,network=Network(3f2414db-1d72-4464-a566-e13dc6cc475c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd6bb7e-c8')
Oct 26 06:46:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Deleting instance files /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e_del
Oct 26 06:46:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Deletion of /opt/stack/data/nova/instances/1ec0a113-9297-4a51-90fc-83951205185e_del complete
Oct 26 06:46:21 user nova-compute[74295]: INFO nova.compute.manager [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 06:46:21 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:21 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid '1ec0a113-9297-4a51-90fc-83951205185e' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid '1ec0a113-9297-4a51-90fc-83951205185e' (instance-0000001d)
Oct 26 06:46:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cff96008-751b-4a4c-8468-5747c454d4da req-41131dc3-1006-4555-9f04-b4c344dc6bb7 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-deleted-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:22 user nova-compute[74295]: INFO nova.compute.manager [req-cff96008-751b-4a4c-8468-5747c454d4da req-41131dc3-1006-4555-9f04-b4c344dc6bb7 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Neutron deleted interface 5bd6bb7e-c803-4e38-a749-33e26c969d0b; detaching it from the instance and deleting it from the info cache
Oct 26 06:46:22 user nova-compute[74295]: DEBUG nova.network.neutron [req-cff96008-751b-4a4c-8468-5747c454d4da req-41131dc3-1006-4555-9f04-b4c344dc6bb7 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:46:22 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Took 0.92 seconds to deallocate network for instance.
Oct 26 06:46:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-cff96008-751b-4a4c-8468-5747c454d4da req-41131dc3-1006-4555-9f04-b4c344dc6bb7 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Detach interface failed, port_id=5bd6bb7e-c803-4e38-a749-33e26c969d0b, reason: Instance 1ec0a113-9297-4a51-90fc-83951205185e could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-17f15f69-73d4-48dd-90aa-ef18edc2a342 req-f73c1263-85ba-4031-b8af-d14e5e6155b1 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-17f15f69-73d4-48dd-90aa-ef18edc2a342 req-f73c1263-85ba-4031-b8af-d14e5e6155b1 service nova] Acquiring lock "1ec0a113-9297-4a51-90fc-83951205185e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-17f15f69-73d4-48dd-90aa-ef18edc2a342 req-f73c1263-85ba-4031-b8af-d14e5e6155b1 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-17f15f69-73d4-48dd-90aa-ef18edc2a342 req-f73c1263-85ba-4031-b8af-d14e5e6155b1 service nova] Lock "1ec0a113-9297-4a51-90fc-83951205185e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-17f15f69-73d4-48dd-90aa-ef18edc2a342 req-f73c1263-85ba-4031-b8af-d14e5e6155b1 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] No waiting events found dispatching network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:22 user nova-compute[74295]: WARNING nova.compute.manager [req-17f15f69-73d4-48dd-90aa-ef18edc2a342 req-f73c1263-85ba-4031-b8af-d14e5e6155b1 service nova] [instance: 1ec0a113-9297-4a51-90fc-83951205185e] Received unexpected event network-vif-plugged-5bd6bb7e-c803-4e38-a749-33e26c969d0b for instance with vm_state deleted and task_state None.
Oct 26 06:46:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:46:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8215MB free_disk=25.152427673339844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:23 user nova-compute[74295]: INFO nova.compute.manager [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Terminating instance
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.655s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.065s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:23 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Deleted allocations for instance 1ec0a113-9297-4a51-90fc-83951205185e
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c002695d-145c-4e74-90ae-aa1133680472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b7eba875-99ff-4eff-b2fc-d053c999cac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:23 user nova-compute[74295]: INFO nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c00e8840-1c48-465b-b611-d9c05339de35 has allocations against this compute host but is not found in the database.
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b073cf40-ecf4-4d1a-92d0-63ffd6541868 tempest-ServerStableDeviceRescueTest-978011123 tempest-ServerStableDeviceRescueTest-978011123-project-member] Lock "1ec0a113-9297-4a51-90fc-83951205185e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:46:23 user nova-compute[74295]: INFO nova.compute.claims [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Claim successful on node user
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:46:23 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Instance destroyed successfully.
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.objects.instance [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lazy-loading 'resources' on Instance uuid 2a48ac34-3913-482f-91bd-7158c5b1f2bb {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-574978432',display_name='tempest-AttachVolumeNegativeTest-server-574978432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-574978432',id=34,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUoZDo6STXbe2dWMhaBeTAZR8XpesCXDGazRS3tjgFmHA9Lcs+r5pFxlCyxYcXea/vK56zP+A9axG3ciyT6s71K5VOj0LToo8CmxgZqV663XlF5KeaFHsfTQ7rSVrL9nQ==',key_name='tempest-keypair-2072277416',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:43:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2c9296eef7f4c45b5275803942de414',ramdisk_id='',reservation_id='r-qhqmdj57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1112300090',owner_user_name='tempest-AttachVolumeNegativeTest-1112300090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a23e0e206f504aaeb7909b322ea2d563',uuid=2a48ac34-3913-482f-91bd-7158c5b1f2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converting VIF {"id": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "address": "fa:16:3e:77:41:2e", "network": {"id": "5801296c-ab17-4117-b353-8fb0250573fa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-795019018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2c9296eef7f4c45b5275803942de414", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d60b5a7-6e", "ovs_interfaceid": "5d60b5a7-6e0d-466e-9bf9-7c686ad4c241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:41:2e,bridge_name='br-int',has_traffic_filtering=True,id=5d60b5a7-6e0d-466e-9bf9-7c686ad4c241,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d60b5a7-6e') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG os_vif [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:41:2e,bridge_name='br-int',has_traffic_filtering=True,id=5d60b5a7-6e0d-466e-9bf9-7c686ad4c241,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d60b5a7-6e') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d60b5a7-6e, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65609dac-bcda-42e3-851a-d146ef3c10c7) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:46:23 user nova-compute[74295]: INFO os_vif [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:41:2e,bridge_name='br-int',has_traffic_filtering=True,id=5d60b5a7-6e0d-466e-9bf9-7c686ad4c241,network=Network(5801296c-ab17-4117-b353-8fb0250573fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d60b5a7-6e')
Oct 26 06:46:23 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Deleting instance files /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb_del
Oct 26 06:46:23 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Deletion of /opt/stack/data/nova/instances/2a48ac34-3913-482f-91bd-7158c5b1f2bb_del complete
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:46:23 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:46:23 user nova-compute[74295]: INFO nova.compute.manager [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 06:46:23 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:46:23 user nova-compute[74295]: DEBUG nova.policy [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9c6d1df97394e38b83ac8558e5807da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2162840335747c09434fec98e36b92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:46:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Creating image(s)
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "/opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "/opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "/opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk 1073741824" returned: 0 in 0.060s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Successfully created port: 11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:46:24 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Took 0.79 seconds to deallocate network for instance.
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.249s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:24 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received event network-vif-unplugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] No waiting events found dispatching network-vif-unplugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:25 user nova-compute[74295]: WARNING nova.compute.manager [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received unexpected event network-vif-unplugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 for instance with vm_state deleted and task_state None.
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received event network-vif-plugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] Acquiring lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] No waiting events found dispatching network-vif-plugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:25 user nova-compute[74295]: WARNING nova.compute.manager [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received unexpected event network-vif-plugged-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 for instance with vm_state deleted and task_state None.
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-379d94df-6c0b-4bad-adc1-ba980e650683 req-e7a2487f-b964-4f7f-8879-78494f605ffe service nova] [instance: 2a48ac34-3913-482f-91bd-7158c5b1f2bb] Received event network-vif-deleted-5d60b5a7-6e0d-466e-9bf9-7c686ad4c241 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Cannot resize image /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Ensure instance console log exists: /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:25 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Deleted allocations for instance 2a48ac34-3913-482f-91bd-7158c5b1f2bb
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-cbae62ea-cd6d-44ba-94ed-617c24b71b95 tempest-AttachVolumeNegativeTest-1112300090 tempest-AttachVolumeNegativeTest-1112300090-project-member] Lock "2a48ac34-3913-482f-91bd-7158c5b1f2bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Successfully updated port: 11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquired lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-b114b784-680f-4ab6-893f-0de14afcc637 req-a8ec062b-8067-4293-8505-95696c876b24 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received event network-changed-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-b114b784-680f-4ab6-893f-0de14afcc637 req-a8ec062b-8067-4293-8505-95696c876b24 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Refreshing instance network info cache due to event network-changed-11e82fed-031c-4ae0-afea-9a2b44a6bbd9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b114b784-680f-4ab6-893f-0de14afcc637 req-a8ec062b-8067-4293-8505-95696c876b24 service nova] Acquiring lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Updating instance_info_cache with network_info: [{"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Releasing lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Instance network_info: |[{"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b114b784-680f-4ab6-893f-0de14afcc637 req-a8ec062b-8067-4293-8505-95696c876b24 service nova] Acquired lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.network.neutron [req-b114b784-680f-4ab6-893f-0de14afcc637 req-a8ec062b-8067-4293-8505-95696c876b24 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Refreshing network info cache for port 11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Start _get_guest_xml network_info=[{"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:46:25 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:46:25 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1786095175',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1786095175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1786095',id=36,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM5wnHsww8Ro7IKoRBhvEhtrc5tOy2FJ86Hx4OP/avYhl41y2aSbOZ44btl6OBsolnQnlOPZlOyNKMhD4t7BOXnrVPn+rlOsy8/W7u9uinmjgk1UzoMdsMo2cFSD7IKOw==',key_name='tempest-keypair-519104211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2162840335747c09434fec98e36b92b',ramdisk_id='',reservation_id='r-ssp8rxi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-713887727',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c6d1df97394e38b83ac8558e5807da',uuid=c00e8840-1c48-465b-b611-d9c05339de35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Converting VIF {"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:2b:12,bridge_name='br-int',has_traffic_filtering=True,id=11e82fed-031c-4ae0-afea-9a2b44a6bbd9,network=Network(38bb25d3-4c05-4324-8e11-f4460caa1bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e82fed-03') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lazy-loading 'pci_devices' on Instance uuid c00e8840-1c48-465b-b611-d9c05339de35 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:46:25 user nova-compute[74295]:   <uuid>c00e8840-1c48-465b-b611-d9c05339de35</uuid>
Oct 26 06:46:25 user nova-compute[74295]:   <name>instance-00000024</name>
Oct 26 06:46:25 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:46:25 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:46:25 user nova-compute[74295]:   <metadata>
Oct 26 06:46:25 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:46:25 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:46:25 user nova-compute[74295]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1786095175</nova:name>
Oct 26 06:46:25 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:46:25</nova:creationTime>
Oct 26 06:46:25 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:46:25 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:46:25 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:46:25 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:46:25 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:46:25 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:46:25 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:46:25 user nova-compute[74295]:       <nova:owner>
Oct 26 06:46:25 user nova-compute[74295]:         <nova:user uuid="b9c6d1df97394e38b83ac8558e5807da">tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member</nova:user>
Oct 26 06:46:25 user nova-compute[74295]:         <nova:project uuid="c2162840335747c09434fec98e36b92b">tempest-TestServerVolumeAttachScenarioOldVersion-713887727</nova:project>
Oct 26 06:46:25 user nova-compute[74295]:       </nova:owner>
Oct 26 06:46:25 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:46:25 user nova-compute[74295]:       <nova:ports>
Oct 26 06:46:25 user nova-compute[74295]:         <nova:port uuid="11e82fed-031c-4ae0-afea-9a2b44a6bbd9">
Oct 26 06:46:25 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 06:46:25 user nova-compute[74295]:         </nova:port>
Oct 26 06:46:25 user nova-compute[74295]:       </nova:ports>
Oct 26 06:46:25 user nova-compute[74295]:     </nova:instance>
Oct 26 06:46:25 user nova-compute[74295]:   </metadata>
Oct 26 06:46:25 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:46:25 user nova-compute[74295]:     <system>
Oct 26 06:46:25 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:46:25 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:46:25 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:46:25 user nova-compute[74295]:       <entry name="serial">c00e8840-1c48-465b-b611-d9c05339de35</entry>
Oct 26 06:46:25 user nova-compute[74295]:       <entry name="uuid">c00e8840-1c48-465b-b611-d9c05339de35</entry>
Oct 26 06:46:25 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:46:25 user nova-compute[74295]:     </system>
Oct 26 06:46:25 user nova-compute[74295]:   </sysinfo>
Oct 26 06:46:25 user nova-compute[74295]:   <os>
Oct 26 06:46:25 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:46:25 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:46:25 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:46:25 user nova-compute[74295]:   </os>
Oct 26 06:46:25 user nova-compute[74295]:   <features>
Oct 26 06:46:25 user nova-compute[74295]:     <acpi/>
Oct 26 06:46:25 user nova-compute[74295]:     <apic/>
Oct 26 06:46:25 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:46:25 user nova-compute[74295]:   </features>
Oct 26 06:46:25 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:46:25 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:46:25 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:46:25 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:46:25 user nova-compute[74295]:   </clock>
Oct 26 06:46:25 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:46:25 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:46:25 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:46:25 user nova-compute[74295]:   </cpu>
Oct 26 06:46:25 user nova-compute[74295]:   <devices>
Oct 26 06:46:25 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:46:25 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:46:25 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk"/>
Oct 26 06:46:25 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:46:25 user nova-compute[74295]:     </disk>
Oct 26 06:46:25 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:46:25 user nova-compute[74295]:       <mac address="fa:16:3e:6d:2b:12"/>
Oct 26 06:46:25 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:46:25 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:46:25 user nova-compute[74295]:       <target dev="tap11e82fed-03"/>
Oct 26 06:46:25 user nova-compute[74295]:     </interface>
Oct 26 06:46:25 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:46:25 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/console.log" append="off"/>
Oct 26 06:46:25 user nova-compute[74295]:     </serial>
Oct 26 06:46:25 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:46:25 user nova-compute[74295]:     <video>
Oct 26 06:46:25 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:46:25 user nova-compute[74295]:     </video>
Oct 26 06:46:25 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:46:25 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:46:25 user nova-compute[74295]:     </rng>
Oct 26 06:46:25 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:46:25 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:46:25 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:46:25 user nova-compute[74295]:     </memballoon>
Oct 26 06:46:25 user nova-compute[74295]:   </devices>
Oct 26 06:46:25 user nova-compute[74295]: </domain>
Oct 26 06:46:25 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1786095175',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1786095175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1786095',id=36,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM5wnHsww8Ro7IKoRBhvEhtrc5tOy2FJ86Hx4OP/avYhl41y2aSbOZ44btl6OBsolnQnlOPZlOyNKMhD4t7BOXnrVPn+rlOsy8/W7u9uinmjgk1UzoMdsMo2cFSD7IKOw==',key_name='tempest-keypair-519104211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2162840335747c09434fec98e36b92b',ramdisk_id='',reservation_id='r-ssp8rxi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-713887727',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c6d1df97394e38b83ac8558e5807da',uuid=c00e8840-1c48-465b-b611-d9c05339de35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Converting VIF {"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:2b:12,bridge_name='br-int',has_traffic_filtering=True,id=11e82fed-031c-4ae0-afea-9a2b44a6bbd9,network=Network(38bb25d3-4c05-4324-8e11-f4460caa1bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e82fed-03') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG os_vif [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:2b:12,bridge_name='br-int',has_traffic_filtering=True,id=11e82fed-031c-4ae0-afea-9a2b44a6bbd9,network=Network(38bb25d3-4c05-4324-8e11-f4460caa1bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e82fed-03') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '330608d1-80af-571a-851f-5d1963b3e77e', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11e82fed-03, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11e82fed-03, col_values=(('qos', UUID('b0b4e406-c54b-4ea4-aa8a-031c8929063d')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11e82fed-03, col_values=(('external_ids', {'iface-id': '11e82fed-031c-4ae0-afea-9a2b44a6bbd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:2b:12', 'vm-uuid': 'c00e8840-1c48-465b-b611-d9c05339de35'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:25 user nova-compute[74295]: INFO os_vif [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:2b:12,bridge_name='br-int',has_traffic_filtering=True,id=11e82fed-031c-4ae0-afea-9a2b44a6bbd9,network=Network(38bb25d3-4c05-4324-8e11-f4460caa1bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e82fed-03')
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:46:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] No VIF found with MAC fa:16:3e:6d:2b:12, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:46:26 user nova-compute[74295]: DEBUG nova.network.neutron [req-b114b784-680f-4ab6-893f-0de14afcc637 req-a8ec062b-8067-4293-8505-95696c876b24 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Updated VIF entry in instance network info cache for port 11e82fed-031c-4ae0-afea-9a2b44a6bbd9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:46:26 user nova-compute[74295]: DEBUG nova.network.neutron [req-b114b784-680f-4ab6-893f-0de14afcc637 req-a8ec062b-8067-4293-8505-95696c876b24 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Updating instance_info_cache with network_info: [{"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:46:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b114b784-680f-4ab6-893f-0de14afcc637 req-a8ec062b-8067-4293-8505-95696c876b24 service nova] Releasing lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG nova.compute.manager [req-2afaf704-25c8-42db-a7ba-e7853ec92ddf req-3a59fb85-4be6-4742-a720-aa7ff149efc1 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received event network-vif-plugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2afaf704-25c8-42db-a7ba-e7853ec92ddf req-3a59fb85-4be6-4742-a720-aa7ff149efc1 service nova] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2afaf704-25c8-42db-a7ba-e7853ec92ddf req-3a59fb85-4be6-4742-a720-aa7ff149efc1 service nova] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2afaf704-25c8-42db-a7ba-e7853ec92ddf req-3a59fb85-4be6-4742-a720-aa7ff149efc1 service nova] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG nova.compute.manager [req-2afaf704-25c8-42db-a7ba-e7853ec92ddf req-3a59fb85-4be6-4742-a720-aa7ff149efc1 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] No waiting events found dispatching network-vif-plugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:27 user nova-compute[74295]: WARNING nova.compute.manager [req-2afaf704-25c8-42db-a7ba-e7853ec92ddf req-3a59fb85-4be6-4742-a720-aa7ff149efc1 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received unexpected event network-vif-plugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 for instance with vm_state building and task_state spawning.
Oct 26 06:46:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:46:29 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Instance spawned successfully.
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.compute.manager [req-c946cb08-d27c-43cb-acde-00154e6ad447 req-268d5343-1eba-482e-ac37-d0518e2535d7 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received event network-vif-plugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c946cb08-d27c-43cb-acde-00154e6ad447 req-268d5343-1eba-482e-ac37-d0518e2535d7 service nova] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c946cb08-d27c-43cb-acde-00154e6ad447 req-268d5343-1eba-482e-ac37-d0518e2535d7 service nova] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c946cb08-d27c-43cb-acde-00154e6ad447 req-268d5343-1eba-482e-ac37-d0518e2535d7 service nova] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.compute.manager [req-c946cb08-d27c-43cb-acde-00154e6ad447 req-268d5343-1eba-482e-ac37-d0518e2535d7 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] No waiting events found dispatching network-vif-plugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:29 user nova-compute[74295]: WARNING nova.compute.manager [req-c946cb08-d27c-43cb-acde-00154e6ad447 req-268d5343-1eba-482e-ac37-d0518e2535d7 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received unexpected event network-vif-plugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 for instance with vm_state building and task_state spawning.
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:46:29 user nova-compute[74295]: INFO nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Took 5.35 seconds to spawn the instance on the hypervisor.
Oct 26 06:46:29 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:29 user nova-compute[74295]: INFO nova.compute.manager [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Took 6.02 seconds to build instance.
Oct 26 06:46:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3f5a4d85-6015-488a-883a-c5b4e07d146f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.142s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:46:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "c002695d-145c-4e74-90ae-aa1133680472" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:39 user nova-compute[74295]: INFO nova.compute.manager [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Terminating instance
Oct 26 06:46:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-91d78cf9-7490-412c-b7be-0b154da21d5f req-e41ac049-b660-426d-9928-d0e5ae0db256 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received event network-vif-unplugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-91d78cf9-7490-412c-b7be-0b154da21d5f req-e41ac049-b660-426d-9928-d0e5ae0db256 service nova] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-91d78cf9-7490-412c-b7be-0b154da21d5f req-e41ac049-b660-426d-9928-d0e5ae0db256 service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-91d78cf9-7490-412c-b7be-0b154da21d5f req-e41ac049-b660-426d-9928-d0e5ae0db256 service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-91d78cf9-7490-412c-b7be-0b154da21d5f req-e41ac049-b660-426d-9928-d0e5ae0db256 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] No waiting events found dispatching network-vif-unplugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-91d78cf9-7490-412c-b7be-0b154da21d5f req-e41ac049-b660-426d-9928-d0e5ae0db256 service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received event network-vif-unplugged-85b8870e-a0e3-4389-81c3-ce5277631633 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c002695d-145c-4e74-90ae-aa1133680472] Instance destroyed successfully.
Oct 26 06:46:40 user nova-compute[74295]: DEBUG nova.objects.instance [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lazy-loading 'resources' on Instance uuid c002695d-145c-4e74-90ae-aa1133680472 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-115586872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-115586872',id=2,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0ac89a741e94482bf18b56aca6a53c1',ramdisk_id='',reservation_id='r-ad8ue8iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:28:05Z,user_data=None,user_id='969b88effa7b4c14a9fdca34760804e8',uuid=c002695d-145c-4e74-90ae-aa1133680472,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converting VIF {"id": "85b8870e-a0e3-4389-81c3-ce5277631633", "address": "fa:16:3e:32:99:2c", "network": {"id": "048d3c21-eb7d-4628-a7f0-4245219b6dee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1787989677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0ac89a741e94482bf18b56aca6a53c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85b8870e-a0", "ovs_interfaceid": "85b8870e-a0e3-4389-81c3-ce5277631633", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:99:2c,bridge_name='br-int',has_traffic_filtering=True,id=85b8870e-a0e3-4389-81c3-ce5277631633,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b8870e-a0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG os_vif [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:99:2c,bridge_name='br-int',has_traffic_filtering=True,id=85b8870e-a0e3-4389-81c3-ce5277631633,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b8870e-a0') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85b8870e-a0, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2975a5e5-2185-4220-a830-38a6f6b3d222) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:40 user nova-compute[74295]: INFO os_vif [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:99:2c,bridge_name='br-int',has_traffic_filtering=True,id=85b8870e-a0e3-4389-81c3-ce5277631633,network=Network(048d3c21-eb7d-4628-a7f0-4245219b6dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85b8870e-a0')
Oct 26 06:46:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Deleting instance files /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472_del
Oct 26 06:46:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Deletion of /opt/stack/data/nova/instances/c002695d-145c-4e74-90ae-aa1133680472_del complete
Oct 26 06:46:40 user nova-compute[74295]: INFO nova.compute.manager [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] [instance: c002695d-145c-4e74-90ae-aa1133680472] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 26 06:46:40 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: c002695d-145c-4e74-90ae-aa1133680472] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:46:40 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c002695d-145c-4e74-90ae-aa1133680472] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c002695d-145c-4e74-90ae-aa1133680472] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:41 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: c002695d-145c-4e74-90ae-aa1133680472] Took 0.43 seconds to deallocate network for instance.
Oct 26 06:46:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-bbd6669d-b605-4af0-9eb1-28b3f01b298b req-0977f665-521f-4c38-8734-c0936c4cf41f service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received event network-vif-deleted-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:46:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:41 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Deleted allocations for instance c002695d-145c-4e74-90ae-aa1133680472
Oct 26 06:46:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-56cc368e-b55a-462a-a25e-d6a034dd4cd6 tempest-ServerBootFromVolumeStableRescueTest-1259261992 tempest-ServerBootFromVolumeStableRescueTest-1259261992-project-member] Lock "c002695d-145c-4e74-90ae-aa1133680472" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] No waiting events found dispatching network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:42 user nova-compute[74295]: WARNING nova.compute.manager [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received unexpected event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 for instance with vm_state deleted and task_state None.
Oct 26 06:46:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] No waiting events found dispatching network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:42 user nova-compute[74295]: WARNING nova.compute.manager [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received unexpected event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 for instance with vm_state deleted and task_state None.
Oct 26 06:46:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] Acquiring lock "c002695d-145c-4e74-90ae-aa1133680472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] Lock "c002695d-145c-4e74-90ae-aa1133680472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] No waiting events found dispatching network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:46:42 user nova-compute[74295]: WARNING nova.compute.manager [req-9d728ab8-64fa-40d2-81ca-f88bd3d7becb req-3978a686-af37-451d-a4a3-8316f66858ab service nova] [instance: c002695d-145c-4e74-90ae-aa1133680472] Received unexpected event network-vif-plugged-85b8870e-a0e3-4389-81c3-ce5277631633 for instance with vm_state deleted and task_state None.
Oct 26 06:46:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-154ebbb3-b9a5-471b-8567-9e4ac7e07ee6 req-71d49e34-d1f4-425c-8d90-5c842a177bbd service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received event network-changed-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:45 user nova-compute[74295]: DEBUG nova.compute.manager [req-154ebbb3-b9a5-471b-8567-9e4ac7e07ee6 req-71d49e34-d1f4-425c-8d90-5c842a177bbd service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Refreshing instance network info cache due to event network-changed-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:46:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-154ebbb3-b9a5-471b-8567-9e4ac7e07ee6 req-71d49e34-d1f4-425c-8d90-5c842a177bbd service nova] Acquiring lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:46:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-154ebbb3-b9a5-471b-8567-9e4ac7e07ee6 req-71d49e34-d1f4-425c-8d90-5c842a177bbd service nova] Acquired lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:46:45 user nova-compute[74295]: DEBUG nova.network.neutron [req-154ebbb3-b9a5-471b-8567-9e4ac7e07ee6 req-71d49e34-d1f4-425c-8d90-5c842a177bbd service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Refreshing network info cache for port 3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:46:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-154ebbb3-b9a5-471b-8567-9e4ac7e07ee6 req-71d49e34-d1f4-425c-8d90-5c842a177bbd service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Updated VIF entry in instance network info cache for port 3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:46:46 user nova-compute[74295]: DEBUG nova.network.neutron [req-154ebbb3-b9a5-471b-8567-9e4ac7e07ee6 req-71d49e34-d1f4-425c-8d90-5c842a177bbd service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Updating instance_info_cache with network_info: [{"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:46:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-154ebbb3-b9a5-471b-8567-9e4ac7e07ee6 req-71d49e34-d1f4-425c-8d90-5c842a177bbd service nova] Releasing lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:46:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:46:57 user nova-compute[74295]: INFO nova.compute.claims [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Claim successful on node user
Oct 26 06:46:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG nova.network.neutron [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:46:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:46:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:46:57 user nova-compute[74295]: DEBUG nova.policy [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ce2ec6aad1e4e068958bcc61d50cb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a74a5d314a4075923b5c21b2c39097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:46:58 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Creating image(s)
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk 1073741824" returned: 0 in 0.067s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Successfully created port: 76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Cannot resize image /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Ensure instance console log exists: /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:46:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Successfully updated port: 76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquired lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-56874e96-0e8f-4327-9021-edd09ad6c7be req-ea900bff-5c84-415a-92e7-13ee12ba8d19 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-changed-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-56874e96-0e8f-4327-9021-edd09ad6c7be req-ea900bff-5c84-415a-92e7-13ee12ba8d19 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Refreshing instance network info cache due to event network-changed-76720f8b-41b5-44f4-b4d3-5f501b977acb. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56874e96-0e8f-4327-9021-edd09ad6c7be req-ea900bff-5c84-415a-92e7-13ee12ba8d19 service nova] Acquiring lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating instance_info_cache with network_info: [{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Releasing lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance network_info: |[{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56874e96-0e8f-4327-9021-edd09ad6c7be req-ea900bff-5c84-415a-92e7-13ee12ba8d19 service nova] Acquired lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-56874e96-0e8f-4327-9021-edd09ad6c7be req-ea900bff-5c84-415a-92e7-13ee12ba8d19 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Refreshing network info cache for port 76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Start _get_guest_xml network_info=[{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:46:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:46:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1987518129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1987518129',id=37,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhL+j1T2jaZDC4siRAiEALDqrNUrSEv5SOAEBUZRHM+o0/6cDlpz+0XtUCGyQJ5Xl0GFgf4wERK7g7yCmcEqhT2OqWWJo1Fwa55ObRVj+BtaPs8U4pJbdlsGqYGYA85qA==',key_name='tempest-keypair-52913859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-432f93yk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=cfde0bac-90db-40c0-90c6-957b2baf948c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.objects.instance [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'pci_devices' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:46:59 user nova-compute[74295]:   <uuid>cfde0bac-90db-40c0-90c6-957b2baf948c</uuid>
Oct 26 06:46:59 user nova-compute[74295]:   <name>instance-00000025</name>
Oct 26 06:46:59 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:46:59 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:46:59 user nova-compute[74295]:   <metadata>
Oct 26 06:46:59 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:46:59 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:46:59 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1987518129</nova:name>
Oct 26 06:46:59 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:46:59</nova:creationTime>
Oct 26 06:46:59 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:46:59 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:46:59 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:46:59 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:46:59 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:46:59 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:46:59 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:46:59 user nova-compute[74295]:       <nova:owner>
Oct 26 06:46:59 user nova-compute[74295]:         <nova:user uuid="8ce2ec6aad1e4e068958bcc61d50cb73">tempest-AttachVolumeShelveTestJSON-1252316399-project-member</nova:user>
Oct 26 06:46:59 user nova-compute[74295]:         <nova:project uuid="74a74a5d314a4075923b5c21b2c39097">tempest-AttachVolumeShelveTestJSON-1252316399</nova:project>
Oct 26 06:46:59 user nova-compute[74295]:       </nova:owner>
Oct 26 06:46:59 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:46:59 user nova-compute[74295]:       <nova:ports>
Oct 26 06:46:59 user nova-compute[74295]:         <nova:port uuid="76720f8b-41b5-44f4-b4d3-5f501b977acb">
Oct 26 06:46:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 06:46:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:46:59 user nova-compute[74295]:       </nova:ports>
Oct 26 06:46:59 user nova-compute[74295]:     </nova:instance>
Oct 26 06:46:59 user nova-compute[74295]:   </metadata>
Oct 26 06:46:59 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:46:59 user nova-compute[74295]:     <system>
Oct 26 06:46:59 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:46:59 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:46:59 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:46:59 user nova-compute[74295]:       <entry name="serial">cfde0bac-90db-40c0-90c6-957b2baf948c</entry>
Oct 26 06:46:59 user nova-compute[74295]:       <entry name="uuid">cfde0bac-90db-40c0-90c6-957b2baf948c</entry>
Oct 26 06:46:59 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:46:59 user nova-compute[74295]:     </system>
Oct 26 06:46:59 user nova-compute[74295]:   </sysinfo>
Oct 26 06:46:59 user nova-compute[74295]:   <os>
Oct 26 06:46:59 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:46:59 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:46:59 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:46:59 user nova-compute[74295]:   </os>
Oct 26 06:46:59 user nova-compute[74295]:   <features>
Oct 26 06:46:59 user nova-compute[74295]:     <acpi/>
Oct 26 06:46:59 user nova-compute[74295]:     <apic/>
Oct 26 06:46:59 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:46:59 user nova-compute[74295]:   </features>
Oct 26 06:46:59 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:46:59 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:46:59 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:46:59 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:46:59 user nova-compute[74295]:   </clock>
Oct 26 06:46:59 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:46:59 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:46:59 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:46:59 user nova-compute[74295]:   </cpu>
Oct 26 06:46:59 user nova-compute[74295]:   <devices>
Oct 26 06:46:59 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:46:59 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:46:59 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk"/>
Oct 26 06:46:59 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:46:59 user nova-compute[74295]:     </disk>
Oct 26 06:46:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:46:59 user nova-compute[74295]:       <mac address="fa:16:3e:cc:64:e5"/>
Oct 26 06:46:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:46:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:46:59 user nova-compute[74295]:       <target dev="tap76720f8b-41"/>
Oct 26 06:46:59 user nova-compute[74295]:     </interface>
Oct 26 06:46:59 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:46:59 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/console.log" append="off"/>
Oct 26 06:46:59 user nova-compute[74295]:     </serial>
Oct 26 06:46:59 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:46:59 user nova-compute[74295]:     <video>
Oct 26 06:46:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:46:59 user nova-compute[74295]:     </video>
Oct 26 06:46:59 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:46:59 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:46:59 user nova-compute[74295]:     </rng>
Oct 26 06:46:59 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:46:59 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:46:59 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:46:59 user nova-compute[74295]:     </memballoon>
Oct 26 06:46:59 user nova-compute[74295]:   </devices>
Oct 26 06:46:59 user nova-compute[74295]: </domain>
Oct 26 06:46:59 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1987518129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1987518129',id=37,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhL+j1T2jaZDC4siRAiEALDqrNUrSEv5SOAEBUZRHM+o0/6cDlpz+0XtUCGyQJ5Xl0GFgf4wERK7g7yCmcEqhT2OqWWJo1Fwa55ObRVj+BtaPs8U4pJbdlsGqYGYA85qA==',key_name='tempest-keypair-52913859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-432f93yk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=cfde0bac-90db-40c0-90c6-957b2baf948c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG os_vif [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac0a0b9e-b52c-5cca-8ba8-2e0b9b92951a', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76720f8b-41, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76720f8b-41, col_values=(('qos', UUID('d6c0b0ea-c2c7-4d18-a45f-0926be2167c6')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76720f8b-41, col_values=(('external_ids', {'iface-id': '76720f8b-41b5-44f4-b4d3-5f501b977acb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:64:e5', 'vm-uuid': 'cfde0bac-90db-40c0-90c6-957b2baf948c'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:46:59 user nova-compute[74295]: INFO os_vif [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41')
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:46:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] No VIF found with MAC fa:16:3e:cc:64:e5, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:47:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-56874e96-0e8f-4327-9021-edd09ad6c7be req-ea900bff-5c84-415a-92e7-13ee12ba8d19 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updated VIF entry in instance network info cache for port 76720f8b-41b5-44f4-b4d3-5f501b977acb. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:47:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-56874e96-0e8f-4327-9021-edd09ad6c7be req-ea900bff-5c84-415a-92e7-13ee12ba8d19 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating instance_info_cache with network_info: [{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:47:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56874e96-0e8f-4327-9021-edd09ad6c7be req-ea900bff-5c84-415a-92e7-13ee12ba8d19 service nova] Releasing lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:47:01 user nova-compute[74295]: INFO nova.compute.claims [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Claim successful on node user
Oct 26 06:47:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-deca6e7b-1df8-4862-88f6-df86a85473ef req-d6d9b98e-1910-4fff-832e-08f761de4d6f service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-deca6e7b-1df8-4862-88f6-df86a85473ef req-d6d9b98e-1910-4fff-832e-08f761de4d6f service nova] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-deca6e7b-1df8-4862-88f6-df86a85473ef req-d6d9b98e-1910-4fff-832e-08f761de4d6f service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-deca6e7b-1df8-4862-88f6-df86a85473ef req-d6d9b98e-1910-4fff-832e-08f761de4d6f service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-deca6e7b-1df8-4862-88f6-df86a85473ef req-d6d9b98e-1910-4fff-832e-08f761de4d6f service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] No waiting events found dispatching network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:47:01 user nova-compute[74295]: WARNING nova.compute.manager [req-deca6e7b-1df8-4862-88f6-df86a85473ef req-d6d9b98e-1910-4fff-832e-08f761de4d6f service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received unexpected event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb for instance with vm_state building and task_state spawning.
Oct 26 06:47:01 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:47:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:47:01 user nova-compute[74295]: DEBUG nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:47:01 user nova-compute[74295]: DEBUG nova.network.neutron [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:47:02 user nova-compute[74295]: DEBUG nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:47:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:02 user nova-compute[74295]: DEBUG nova.policy [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f8c68bbe2245c6b6f159c45e006216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe63ca1f244085963c38b864dff1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:47:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:02 user nova-compute[74295]: INFO nova.virt.block_device [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Booting with volume snapshot 60b23e01-2c35-4d97-974e-282c7d9b2237 at /dev/vda
Oct 26 06:47:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Successfully created port: 22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Successfully updated port: 22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "refresh_cache-e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquired lock "refresh_cache-e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-426fe43f-6978-46c0-9962-a31a24ba9a6b req-a2093b96-a91f-4c8a-87de-4a52eeb0b2a2 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received event network-changed-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-426fe43f-6978-46c0-9962-a31a24ba9a6b req-a2093b96-a91f-4c8a-87de-4a52eeb0b2a2 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Refreshing instance network info cache due to event network-changed-22be2713-662e-438d-852d-3946776cd2e8. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-426fe43f-6978-46c0-9962-a31a24ba9a6b req-a2093b96-a91f-4c8a-87de-4a52eeb0b2a2 service nova] Acquiring lock "refresh_cache-e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-cbd1a76c-728f-49e3-abdb-eb2e4e1b2921 req-1809fef3-137f-4988-829b-a2d5096dcb80 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cbd1a76c-728f-49e3-abdb-eb2e4e1b2921 req-1809fef3-137f-4988-829b-a2d5096dcb80 service nova] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cbd1a76c-728f-49e3-abdb-eb2e4e1b2921 req-1809fef3-137f-4988-829b-a2d5096dcb80 service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cbd1a76c-728f-49e3-abdb-eb2e4e1b2921 req-1809fef3-137f-4988-829b-a2d5096dcb80 service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-cbd1a76c-728f-49e3-abdb-eb2e4e1b2921 req-1809fef3-137f-4988-829b-a2d5096dcb80 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] No waiting events found dispatching network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:47:03 user nova-compute[74295]: WARNING nova.compute.manager [req-cbd1a76c-728f-49e3-abdb-eb2e4e1b2921 req-1809fef3-137f-4988-829b-a2d5096dcb80 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received unexpected event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb for instance with vm_state building and task_state spawning.
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:47:03 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance spawned successfully.
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.network.neutron [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Updating instance_info_cache with network_info: [{"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Releasing lock "refresh_cache-e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Instance network_info: |[{"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-426fe43f-6978-46c0-9962-a31a24ba9a6b req-a2093b96-a91f-4c8a-87de-4a52eeb0b2a2 service nova] Acquired lock "refresh_cache-e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-426fe43f-6978-46c0-9962-a31a24ba9a6b req-a2093b96-a91f-4c8a-87de-4a52eeb0b2a2 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Refreshing network info cache for port 22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:47:03 user nova-compute[74295]: INFO nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Took 5.79 seconds to spawn the instance on the hypervisor.
Oct 26 06:47:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:47:03 user nova-compute[74295]: INFO nova.compute.manager [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Took 6.51 seconds to build instance.
Oct 26 06:47:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-461c8bb1-225c-4772-93ba-eb330d3b6501 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.621s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-426fe43f-6978-46c0-9962-a31a24ba9a6b req-a2093b96-a91f-4c8a-87de-4a52eeb0b2a2 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Updated VIF entry in instance network info cache for port 22be2713-662e-438d-852d-3946776cd2e8. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:47:04 user nova-compute[74295]: DEBUG nova.network.neutron [req-426fe43f-6978-46c0-9962-a31a24ba9a6b req-a2093b96-a91f-4c8a-87de-4a52eeb0b2a2 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Updating instance_info_cache with network_info: [{"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:47:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-426fe43f-6978-46c0-9962-a31a24ba9a6b req-a2093b96-a91f-4c8a-87de-4a52eeb0b2a2 service nova] Releasing lock "refresh_cache-e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:47:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG os_brick.utils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[145504ab-bde1-4930-a12e-2e94464179ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d2183-416a-4366-9fe7-a4bf45c9552e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1637d3-847e-455a-a9e9-c90a4a543408]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[547f2115-7852-4623-a950-c5ca55c9a607]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:47:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:47:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:47:08 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:47:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ee64da-a194-47f8-93d3-bb6b17057381]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:47:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:47:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:47:08 user nova-compute[74295]: DEBUG os_brick.utils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:47:08 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Updating existing volume attachment record: 561ab5b8-b9bd-4b09-b4d7-5861619d192d {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:47:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:15 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:17 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 06:47:17 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 06:47:19 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:47:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:20 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:47:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:47:22 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:47:22 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8175MB free_disk=25.27374267578125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b7eba875-99ff-4eff-b2fc-d053c999cac5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c00e8840-1c48-465b-b611-d9c05339de35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cfde0bac-90db-40c0-90c6-957b2baf948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:47:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:47:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:47:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Skipping network cache update for instance because it is Building. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 06:47:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:47:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:47:23 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:47:23 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:47:24 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updating instance_info_cache with network_info: [{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:47:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:47:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:47:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:47:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Creating image(s)
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Ensure instance console log exists: /opt/stack/data/nova/instances/e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Start _get_guest_xml network_info=[{"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T06:46:47Z,direct_url=<?>,disk_format='qcow2',id=074140e5-ca38-44a8-a27f-6d5541282376,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2122785161',owner='75fe63ca1f244085963c38b864dff1db',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T06:46:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '561ab5b8-b9bd-4b09-b4d7-5861619d192d', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWLbfZkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1', 'serial': 'fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:47:27 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:47:27 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T06:46:47Z,direct_url=<?>,disk_format='qcow2',id=074140e5-ca38-44a8-a27f-6d5541282376,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2122785161',owner='75fe63ca1f244085963c38b864dff1db',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T06:46:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWLbfZkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:47:27 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:47:27 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:47:27 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c1896-9a16-4765-a358-e6b02b3bf458]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:47:27 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d179b8-0164-4414-8259-13f0ea6e5f15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1] added
Oct 26 06:47:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a625433b-0978-41f8-a0b7-da44b5e56663]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a5da42-8b1b-40f8-b206-02e89de7cdc4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWLbfZkK {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWLbfZkK" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a63d09b-000d-4803-ae25-321564a89af5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wWLbfZkK'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40c434e-86b5-4eb7-8236-b63628a44842]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[74777230-1347-49b3-af81-2571d28bd3d4]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd1ebf7-72a3-46af-b8af-7a5f1828d358]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1, portal: 172.16.0.220,3260]
Oct 26 06:47:27 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1, portal: 172.16.0.220,3260] successful.
Oct 26 06:47:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1826e3b-e7e7-4766-8b93-f66584862231]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a835210-70b6-4de1-b063-49f209719025]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:47:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46c9f6d-bdb9-46ec-8152-b5fca02dd5fa]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:47:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWLbfZkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23639656364633631', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639656364633631', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1968305290',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1968305290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1968305290',id=38,image_ref='074140e5-ca38-44a8-a27f-6d5541282376',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq4qtH0WI59Dseojk49lCfQzxCmOFGUGT6TSmr13cj5uKakXTiTkO4ZIkMVDq8Bl6ZnPtWOE/iimXJWyehuxgRLw1f+ouRChN1OVDYlFXmVFm2PwD5S85Pw4rmBI7c8KA==',key_name='tempest-keypair-976332101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-ac38t07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-594294549',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ef:77,bridge_name='br-int',has_traffic_filtering=True,id=22be2713-662e-438d-852d-3946776cd2e8,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be2713-66') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.objects.instance [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'pci_devices' on Instance uuid e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:47:28 user nova-compute[74295]:   <uuid>e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e</uuid>
Oct 26 06:47:28 user nova-compute[74295]:   <name>instance-00000026</name>
Oct 26 06:47:28 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:47:28 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:47:28 user nova-compute[74295]:   <metadata>
Oct 26 06:47:28 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:47:28 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:47:28 user nova-compute[74295]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1968305290</nova:name>
Oct 26 06:47:28 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:47:27</nova:creationTime>
Oct 26 06:47:28 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:47:28 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:47:28 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:47:28 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:47:28 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:47:28 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:47:28 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:47:28 user nova-compute[74295]:       <nova:owner>
Oct 26 06:47:28 user nova-compute[74295]:         <nova:user uuid="11f8c68bbe2245c6b6f159c45e006216">tempest-TestVolumeBootPattern-594294549-project-member</nova:user>
Oct 26 06:47:28 user nova-compute[74295]:         <nova:project uuid="75fe63ca1f244085963c38b864dff1db">tempest-TestVolumeBootPattern-594294549</nova:project>
Oct 26 06:47:28 user nova-compute[74295]:       </nova:owner>
Oct 26 06:47:28 user nova-compute[74295]:       <nova:root type="image" uuid="074140e5-ca38-44a8-a27f-6d5541282376"/>
Oct 26 06:47:28 user nova-compute[74295]:       <nova:ports>
Oct 26 06:47:28 user nova-compute[74295]:         <nova:port uuid="22be2713-662e-438d-852d-3946776cd2e8">
Oct 26 06:47:28 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 06:47:28 user nova-compute[74295]:         </nova:port>
Oct 26 06:47:28 user nova-compute[74295]:       </nova:ports>
Oct 26 06:47:28 user nova-compute[74295]:     </nova:instance>
Oct 26 06:47:28 user nova-compute[74295]:   </metadata>
Oct 26 06:47:28 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:47:28 user nova-compute[74295]:     <system>
Oct 26 06:47:28 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:47:28 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:47:28 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:47:28 user nova-compute[74295]:       <entry name="serial">e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e</entry>
Oct 26 06:47:28 user nova-compute[74295]:       <entry name="uuid">e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e</entry>
Oct 26 06:47:28 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:47:28 user nova-compute[74295]:     </system>
Oct 26 06:47:28 user nova-compute[74295]:   </sysinfo>
Oct 26 06:47:28 user nova-compute[74295]:   <os>
Oct 26 06:47:28 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:47:28 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:47:28 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:47:28 user nova-compute[74295]:   </os>
Oct 26 06:47:28 user nova-compute[74295]:   <features>
Oct 26 06:47:28 user nova-compute[74295]:     <acpi/>
Oct 26 06:47:28 user nova-compute[74295]:     <apic/>
Oct 26 06:47:28 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:47:28 user nova-compute[74295]:   </features>
Oct 26 06:47:28 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:47:28 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:47:28 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:47:28 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:47:28 user nova-compute[74295]:   </clock>
Oct 26 06:47:28 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:47:28 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:47:28 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:47:28 user nova-compute[74295]:   </cpu>
Oct 26 06:47:28 user nova-compute[74295]:   <devices>
Oct 26 06:47:28 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:47:28 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:47:28 user nova-compute[74295]:       <source dev="/dev/sdd"/>
Oct 26 06:47:28 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:47:28 user nova-compute[74295]:       <serial>fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1</serial>
Oct 26 06:47:28 user nova-compute[74295]:     </disk>
Oct 26 06:47:28 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:47:28 user nova-compute[74295]:       <mac address="fa:16:3e:bc:ef:77"/>
Oct 26 06:47:28 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:47:28 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:47:28 user nova-compute[74295]:       <target dev="tap22be2713-66"/>
Oct 26 06:47:28 user nova-compute[74295]:     </interface>
Oct 26 06:47:28 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:47:28 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e/console.log" append="off"/>
Oct 26 06:47:28 user nova-compute[74295]:     </serial>
Oct 26 06:47:28 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:47:28 user nova-compute[74295]:     <video>
Oct 26 06:47:28 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:47:28 user nova-compute[74295]:     </video>
Oct 26 06:47:28 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:47:28 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:47:28 user nova-compute[74295]:     </rng>
Oct 26 06:47:28 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:47:28 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:47:28 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:47:28 user nova-compute[74295]:     </memballoon>
Oct 26 06:47:28 user nova-compute[74295]:   </devices>
Oct 26 06:47:28 user nova-compute[74295]: </domain>
Oct 26 06:47:28 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1968305290',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1968305290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1968305290',id=38,image_ref='074140e5-ca38-44a8-a27f-6d5541282376',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq4qtH0WI59Dseojk49lCfQzxCmOFGUGT6TSmr13cj5uKakXTiTkO4ZIkMVDq8Bl6ZnPtWOE/iimXJWyehuxgRLw1f+ouRChN1OVDYlFXmVFm2PwD5S85Pw4rmBI7c8KA==',key_name='tempest-keypair-976332101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-ac38t07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-594294549',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ef:77,bridge_name='br-int',has_traffic_filtering=True,id=22be2713-662e-438d-852d-3946776cd2e8,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be2713-66') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG os_vif [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ef:77,bridge_name='br-int',has_traffic_filtering=True,id=22be2713-662e-438d-852d-3946776cd2e8,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be2713-66') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a889bf38-acf7-5dc7-a2cd-3d8ea447c77f', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22be2713-66, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22be2713-66, col_values=(('qos', UUID('c3bb34d5-0571-421d-84ed-ca308b91a321')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22be2713-66, col_values=(('external_ids', {'iface-id': '22be2713-662e-438d-852d-3946776cd2e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:ef:77', 'vm-uuid': 'e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:28 user nova-compute[74295]: INFO os_vif [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ef:77,bridge_name='br-int',has_traffic_filtering=True,id=22be2713-662e-438d-852d-3946776cd2e8,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be2713-66')
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:47:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No VIF found with MAC fa:16:3e:bc:ef:77, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:47:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-92557587-e175-4cee-bd41-4ed3a0a2ef8b req-44d99f2c-58ef-4be0-b35f-967d693a3bda service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received event network-vif-plugged-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-92557587-e175-4cee-bd41-4ed3a0a2ef8b req-44d99f2c-58ef-4be0-b35f-967d693a3bda service nova] Acquiring lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-92557587-e175-4cee-bd41-4ed3a0a2ef8b req-44d99f2c-58ef-4be0-b35f-967d693a3bda service nova] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-92557587-e175-4cee-bd41-4ed3a0a2ef8b req-44d99f2c-58ef-4be0-b35f-967d693a3bda service nova] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-92557587-e175-4cee-bd41-4ed3a0a2ef8b req-44d99f2c-58ef-4be0-b35f-967d693a3bda service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] No waiting events found dispatching network-vif-plugged-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:47:30 user nova-compute[74295]: WARNING nova.compute.manager [req-92557587-e175-4cee-bd41-4ed3a0a2ef8b req-44d99f2c-58ef-4be0-b35f-967d693a3bda service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received unexpected event network-vif-plugged-22be2713-662e-438d-852d-3946776cd2e8 for instance with vm_state building and task_state spawning.
Oct 26 06:47:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:47:32 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Instance spawned successfully.
Oct 26 06:47:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:32 user nova-compute[74295]: INFO nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Took 5.31 seconds to spawn the instance on the hypervisor.
Oct 26 06:47:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:32 user nova-compute[74295]: INFO nova.compute.manager [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Took 31.28 seconds to build instance.
Oct 26 06:47:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57fe7e47-b5db-4031-8cf2-7917d6c34dad tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.399s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-6d05e93e-04e3-4b44-ab3f-bbbd0ccaaefd req-cb01a1d6-a508-497f-831a-e58fe0864249 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received event network-vif-plugged-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6d05e93e-04e3-4b44-ab3f-bbbd0ccaaefd req-cb01a1d6-a508-497f-831a-e58fe0864249 service nova] Acquiring lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6d05e93e-04e3-4b44-ab3f-bbbd0ccaaefd req-cb01a1d6-a508-497f-831a-e58fe0864249 service nova] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6d05e93e-04e3-4b44-ab3f-bbbd0ccaaefd req-cb01a1d6-a508-497f-831a-e58fe0864249 service nova] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:32 user nova-compute[74295]: DEBUG nova.compute.manager [req-6d05e93e-04e3-4b44-ab3f-bbbd0ccaaefd req-cb01a1d6-a508-497f-831a-e58fe0864249 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] No waiting events found dispatching network-vif-plugged-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:47:32 user nova-compute[74295]: WARNING nova.compute.manager [req-6d05e93e-04e3-4b44-ab3f-bbbd0ccaaefd req-cb01a1d6-a508-497f-831a-e58fe0864249 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received unexpected event network-vif-plugged-22be2713-662e-438d-852d-3946776cd2e8 for instance with vm_state active and task_state None.
Oct 26 06:47:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:47:42 user nova-compute[74295]: INFO nova.compute.claims [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Claim successful on node user
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.network.neutron [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:47:42 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.policy [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '625bb2a8aabc4dc1a2f01e8971623312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d88a851e41145faa5bfb4957480ba60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:47:42 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Creating image(s)
Oct 26 06:47:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquiring lock "/opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "/opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "/opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk 1073741824" returned: 0 in 0.063s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG nova.network.neutron [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Successfully created port: e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Cannot resize image /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Ensure instance console log exists: /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG nova.network.neutron [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Successfully updated port: e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquiring lock "refresh_cache-440fb9b0-8413-4576-b61f-5f66b1122e9a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquired lock "refresh_cache-440fb9b0-8413-4576-b61f-5f66b1122e9a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:47:43 user nova-compute[74295]: DEBUG nova.network.neutron [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-a2d57d3d-3f96-49dd-aadb-8b45c77acc70 req-375a015b-5521-417b-a8b7-21d5f84d701a service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-changed-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-a2d57d3d-3f96-49dd-aadb-8b45c77acc70 req-375a015b-5521-417b-a8b7-21d5f84d701a service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Refreshing instance network info cache due to event network-changed-e39d5f56-a830-45c7-bfae-f8501e19ac16. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a2d57d3d-3f96-49dd-aadb-8b45c77acc70 req-375a015b-5521-417b-a8b7-21d5f84d701a service nova] Acquiring lock "refresh_cache-440fb9b0-8413-4576-b61f-5f66b1122e9a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Updating instance_info_cache with network_info: [{"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Releasing lock "refresh_cache-440fb9b0-8413-4576-b61f-5f66b1122e9a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Instance network_info: |[{"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a2d57d3d-3f96-49dd-aadb-8b45c77acc70 req-375a015b-5521-417b-a8b7-21d5f84d701a service nova] Acquired lock "refresh_cache-440fb9b0-8413-4576-b61f-5f66b1122e9a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-a2d57d3d-3f96-49dd-aadb-8b45c77acc70 req-375a015b-5521-417b-a8b7-21d5f84d701a service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Refreshing network info cache for port e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Start _get_guest_xml network_info=[{"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:47:44 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:47:44 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1342623309',display_name='tempest-VolumesActionsTest-instance-1342623309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1342623309',id=39,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d88a851e41145faa5bfb4957480ba60',ramdisk_id='',reservation_id='r-9dysopxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1373610269',owner_user_name='tempest-VolumesActionsTest-1373610269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:47:43Z,user_data=None,user_id='625bb2a8aabc4dc1a2f01e8971623312',uuid=440fb9b0-8413-4576-b61f-5f66b1122e9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Converting VIF {"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:11,bridge_name='br-int',has_traffic_filtering=True,id=e39d5f56-a830-45c7-bfae-f8501e19ac16,network=Network(83742bc8-eb2c-4e93-9cce-0ff55b3f44dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d5f56-a8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.objects.instance [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lazy-loading 'pci_devices' on Instance uuid 440fb9b0-8413-4576-b61f-5f66b1122e9a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:47:44 user nova-compute[74295]:   <uuid>440fb9b0-8413-4576-b61f-5f66b1122e9a</uuid>
Oct 26 06:47:44 user nova-compute[74295]:   <name>instance-00000027</name>
Oct 26 06:47:44 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:47:44 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:47:44 user nova-compute[74295]:   <metadata>
Oct 26 06:47:44 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:47:44 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:47:44 user nova-compute[74295]:       <nova:name>tempest-VolumesActionsTest-instance-1342623309</nova:name>
Oct 26 06:47:44 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:47:44</nova:creationTime>
Oct 26 06:47:44 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:47:44 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:47:44 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:47:44 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:47:44 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:47:44 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:47:44 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:47:44 user nova-compute[74295]:       <nova:owner>
Oct 26 06:47:44 user nova-compute[74295]:         <nova:user uuid="625bb2a8aabc4dc1a2f01e8971623312">tempest-VolumesActionsTest-1373610269-project-member</nova:user>
Oct 26 06:47:44 user nova-compute[74295]:         <nova:project uuid="1d88a851e41145faa5bfb4957480ba60">tempest-VolumesActionsTest-1373610269</nova:project>
Oct 26 06:47:44 user nova-compute[74295]:       </nova:owner>
Oct 26 06:47:44 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:47:44 user nova-compute[74295]:       <nova:ports>
Oct 26 06:47:44 user nova-compute[74295]:         <nova:port uuid="e39d5f56-a830-45c7-bfae-f8501e19ac16">
Oct 26 06:47:44 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 06:47:44 user nova-compute[74295]:         </nova:port>
Oct 26 06:47:44 user nova-compute[74295]:       </nova:ports>
Oct 26 06:47:44 user nova-compute[74295]:     </nova:instance>
Oct 26 06:47:44 user nova-compute[74295]:   </metadata>
Oct 26 06:47:44 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:47:44 user nova-compute[74295]:     <system>
Oct 26 06:47:44 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:47:44 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:47:44 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:47:44 user nova-compute[74295]:       <entry name="serial">440fb9b0-8413-4576-b61f-5f66b1122e9a</entry>
Oct 26 06:47:44 user nova-compute[74295]:       <entry name="uuid">440fb9b0-8413-4576-b61f-5f66b1122e9a</entry>
Oct 26 06:47:44 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:47:44 user nova-compute[74295]:     </system>
Oct 26 06:47:44 user nova-compute[74295]:   </sysinfo>
Oct 26 06:47:44 user nova-compute[74295]:   <os>
Oct 26 06:47:44 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:47:44 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:47:44 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:47:44 user nova-compute[74295]:   </os>
Oct 26 06:47:44 user nova-compute[74295]:   <features>
Oct 26 06:47:44 user nova-compute[74295]:     <acpi/>
Oct 26 06:47:44 user nova-compute[74295]:     <apic/>
Oct 26 06:47:44 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:47:44 user nova-compute[74295]:   </features>
Oct 26 06:47:44 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:47:44 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:47:44 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:47:44 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:47:44 user nova-compute[74295]:   </clock>
Oct 26 06:47:44 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:47:44 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:47:44 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:47:44 user nova-compute[74295]:   </cpu>
Oct 26 06:47:44 user nova-compute[74295]:   <devices>
Oct 26 06:47:44 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:47:44 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:47:44 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk"/>
Oct 26 06:47:44 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:47:44 user nova-compute[74295]:     </disk>
Oct 26 06:47:44 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:47:44 user nova-compute[74295]:       <mac address="fa:16:3e:6d:99:11"/>
Oct 26 06:47:44 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:47:44 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:47:44 user nova-compute[74295]:       <target dev="tape39d5f56-a8"/>
Oct 26 06:47:44 user nova-compute[74295]:     </interface>
Oct 26 06:47:44 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:47:44 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/console.log" append="off"/>
Oct 26 06:47:44 user nova-compute[74295]:     </serial>
Oct 26 06:47:44 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:47:44 user nova-compute[74295]:     <video>
Oct 26 06:47:44 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:47:44 user nova-compute[74295]:     </video>
Oct 26 06:47:44 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:47:44 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:47:44 user nova-compute[74295]:     </rng>
Oct 26 06:47:44 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:47:44 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:47:44 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:47:44 user nova-compute[74295]:     </memballoon>
Oct 26 06:47:44 user nova-compute[74295]:   </devices>
Oct 26 06:47:44 user nova-compute[74295]: </domain>
Oct 26 06:47:44 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1342623309',display_name='tempest-VolumesActionsTest-instance-1342623309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1342623309',id=39,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d88a851e41145faa5bfb4957480ba60',ramdisk_id='',reservation_id='r-9dysopxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1373610269',owner_user_name='tempest-VolumesActionsTest-1373610269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:47:43Z,user_data=None,user_id='625bb2a8aabc4dc1a2f01e8971623312',uuid=440fb9b0-8413-4576-b61f-5f66b1122e9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Converting VIF {"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:11,bridge_name='br-int',has_traffic_filtering=True,id=e39d5f56-a830-45c7-bfae-f8501e19ac16,network=Network(83742bc8-eb2c-4e93-9cce-0ff55b3f44dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d5f56-a8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG os_vif [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:11,bridge_name='br-int',has_traffic_filtering=True,id=e39d5f56-a830-45c7-bfae-f8501e19ac16,network=Network(83742bc8-eb2c-4e93-9cce-0ff55b3f44dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d5f56-a8') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe07a3ad-2974-59e7-b083-39363b5d20f3', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape39d5f56-a8, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape39d5f56-a8, col_values=(('qos', UUID('7f617fd9-77c5-426d-b33f-feb27936ced1')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape39d5f56-a8, col_values=(('external_ids', {'iface-id': 'e39d5f56-a830-45c7-bfae-f8501e19ac16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:99:11', 'vm-uuid': '440fb9b0-8413-4576-b61f-5f66b1122e9a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:47:44 user nova-compute[74295]: INFO os_vif [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:11,bridge_name='br-int',has_traffic_filtering=True,id=e39d5f56-a830-45c7-bfae-f8501e19ac16,network=Network(83742bc8-eb2c-4e93-9cce-0ff55b3f44dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d5f56-a8')
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] No VIF found with MAC fa:16:3e:6d:99:11, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-a2d57d3d-3f96-49dd-aadb-8b45c77acc70 req-375a015b-5521-417b-a8b7-21d5f84d701a service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Updated VIF entry in instance network info cache for port e39d5f56-a830-45c7-bfae-f8501e19ac16. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-a2d57d3d-3f96-49dd-aadb-8b45c77acc70 req-375a015b-5521-417b-a8b7-21d5f84d701a service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Updating instance_info_cache with network_info: [{"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:47:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a2d57d3d-3f96-49dd-aadb-8b45c77acc70 req-375a015b-5521-417b-a8b7-21d5f84d701a service nova] Releasing lock "refresh_cache-440fb9b0-8413-4576-b61f-5f66b1122e9a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:47:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:46 user nova-compute[74295]: INFO nova.compute.manager [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Detaching volume 4a02d39a-927a-46ec-ae89-f307ce4d5573
Oct 26 06:47:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-ff939229-8580-421d-9275-f221a992eca4 req-291bf37b-9464-4dcd-929e-b2f091fea390 service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ff939229-8580-421d-9275-f221a992eca4 req-291bf37b-9464-4dcd-929e-b2f091fea390 service nova] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ff939229-8580-421d-9275-f221a992eca4 req-291bf37b-9464-4dcd-929e-b2f091fea390 service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ff939229-8580-421d-9275-f221a992eca4 req-291bf37b-9464-4dcd-929e-b2f091fea390 service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-ff939229-8580-421d-9275-f221a992eca4 req-291bf37b-9464-4dcd-929e-b2f091fea390 service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] No waiting events found dispatching network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:47:46 user nova-compute[74295]: WARNING nova.compute.manager [req-ff939229-8580-421d-9275-f221a992eca4 req-291bf37b-9464-4dcd-929e-b2f091fea390 service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received unexpected event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 for instance with vm_state building and task_state spawning.
Oct 26 06:47:46 user nova-compute[74295]: INFO nova.virt.block_device [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Attempting to driver detach volume 4a02d39a-927a-46ec-ae89-f307ce4d5573 from mountpoint /dev/vdb
Oct 26 06:47:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Attempting to detach device vdb from instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:47:46 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:47:46 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:47:46 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:47:46 user nova-compute[74295]:   <serial>4a02d39a-927a-46ec-ae89-f307ce4d5573</serial>
Oct 26 06:47:46 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 06:47:46 user nova-compute[74295]: </disk>
Oct 26 06:47:46 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:47:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully detached device vdb from instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 from the persistent domain config.
Oct 26 06:47:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:47:46 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:47:46 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:47:46 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:47:46 user nova-compute[74295]:   <serial>4a02d39a-927a-46ec-ae89-f307ce4d5573</serial>
Oct 26 06:47:46 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 06:47:46 user nova-compute[74295]: </disk>
Oct 26 06:47:46 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:47:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:47:48 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Instance spawned successfully.
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:47:48 user nova-compute[74295]: INFO nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Took 5.50 seconds to spawn the instance on the hypervisor.
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-28d793fd-3dbc-4fb1-bd97-4b3a3b38d953 req-93be5569-4af5-494d-a8b9-9b167afc3e0c service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-28d793fd-3dbc-4fb1-bd97-4b3a3b38d953 req-93be5569-4af5-494d-a8b9-9b167afc3e0c service nova] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-28d793fd-3dbc-4fb1-bd97-4b3a3b38d953 req-93be5569-4af5-494d-a8b9-9b167afc3e0c service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-28d793fd-3dbc-4fb1-bd97-4b3a3b38d953 req-93be5569-4af5-494d-a8b9-9b167afc3e0c service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-28d793fd-3dbc-4fb1-bd97-4b3a3b38d953 req-93be5569-4af5-494d-a8b9-9b167afc3e0c service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] No waiting events found dispatching network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:47:48 user nova-compute[74295]: WARNING nova.compute.manager [req-28d793fd-3dbc-4fb1-bd97-4b3a3b38d953 req-93be5569-4af5-494d-a8b9-9b167afc3e0c service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received unexpected event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 for instance with vm_state active and task_state None.
Oct 26 06:47:48 user nova-compute[74295]: INFO nova.compute.manager [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Took 6.21 seconds to build instance.
Oct 26 06:47:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-55586f03-710c-4d80-8dfe-3c48341fbb50 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.355s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:47:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:47:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:06 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 is timed out.
Oct 26 06:48:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully detached device vdb from instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 from the live domain config.
Oct 26 06:48:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:48:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwBYQqST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:48:06 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:48:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:48:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:48:06 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b2769f-d94c-4dff-9f8c-ba934f8c5ed6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:48:07 user nova-compute[74295]: No targets found.
Oct 26 06:48:07 user nova-compute[74295]: iSNS:
Oct 26 06:48:07 user nova-compute[74295]: No targets found.
Oct 26 06:48:07 user nova-compute[74295]: STATIC:
Oct 26 06:48:07 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573
Oct 26 06:48:07 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:48:07 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:48:07 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0
Oct 26 06:48:07 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:48:07 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:48:07 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1
Oct 26 06:48:07 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:48:07 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:48:07 user nova-compute[74295]: FIRMWARE:
Oct 26 06:48:07 user nova-compute[74295]: No targets found.
Oct 26 06:48:07 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:48:07 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:48:07 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[698d14de-0998-4f3f-8d9f-db649f92fa18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a827437-ba76-4b86-a59f-9d2a79529b2b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:48:07 user nova-compute[74295]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:48:07 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:48:07 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:48:07 user nova-compute[74295]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 (non-flash)
Oct 26 06:48:07 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:48:07 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1bf250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f704847-5c9b-4f47-b6bf-95b5878e4620]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e75062-a1b2-40dd-b167-7cb4d6201c3a]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b39fb85-09ad-488e-8556-bc96b0f4c795]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb2653-86ca-4617-bd4d-2f92a06da209]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b13b3b2-b213-43b0-8163-ec92e3eafcfe]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d23586-69ea-4aea-bede-cdf890b4bfc1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260]
Oct 26 06:48:07 user nova-compute[74295]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573, portal: 172.16.0.220,3260] successful.
Oct 26 06:48:07 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a02d39a-927a-46ec-ae89-f307ce4d5573 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d73445a-d35c-4ff9-b971-9265689a2413]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== disconnect_volume: return (333ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:48:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:08 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:48:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f5e9d343-6a4c-4b0d-bdb1-046faa02f058 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.008s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-99aa9bb0-94f7-41ca-a805-6eb22093eb73 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-99aa9bb0-94f7-41ca-a805-6eb22093eb73 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-99aa9bb0-94f7-41ca-a805-6eb22093eb73 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-99aa9bb0-94f7-41ca-a805-6eb22093eb73 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74295) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG nova.objects.instance [None req-99aa9bb0-94f7-41ca-a805-6eb22093eb73 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-46d1f6a8-30b3-404b-b48e-4cf6dda94523 req-5a0809c3-ed11-483a-b500-972888376462 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-unplugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-46d1f6a8-30b3-404b-b48e-4cf6dda94523 req-5a0809c3-ed11-483a-b500-972888376462 service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-46d1f6a8-30b3-404b-b48e-4cf6dda94523 req-5a0809c3-ed11-483a-b500-972888376462 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-46d1f6a8-30b3-404b-b48e-4cf6dda94523 req-5a0809c3-ed11-483a-b500-972888376462 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:09 user nova-compute[74295]: DEBUG nova.compute.manager [req-46d1f6a8-30b3-404b-b48e-4cf6dda94523 req-5a0809c3-ed11-483a-b500-972888376462 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-unplugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:48:09 user nova-compute[74295]: WARNING nova.compute.manager [req-46d1f6a8-30b3-404b-b48e-4cf6dda94523 req-5a0809c3-ed11-483a-b500-972888376462 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-unplugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state active and task_state powering-off.
Oct 26 06:48:09 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance destroyed successfully.
Oct 26 06:48:09 user nova-compute[74295]: DEBUG nova.compute.manager [None req-99aa9bb0-94f7-41ca-a805-6eb22093eb73 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:48:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-99aa9bb0-94f7-41ca-a805-6eb22093eb73 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.884s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-283eb14b-3014-496a-8d9f-d8a9f03cbd6b req-a46f05a1-aab7-421e-9c96-51319b89fe94 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-283eb14b-3014-496a-8d9f-d8a9f03cbd6b req-a46f05a1-aab7-421e-9c96-51319b89fe94 service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-283eb14b-3014-496a-8d9f-d8a9f03cbd6b req-a46f05a1-aab7-421e-9c96-51319b89fe94 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-283eb14b-3014-496a-8d9f-d8a9f03cbd6b req-a46f05a1-aab7-421e-9c96-51319b89fe94 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-283eb14b-3014-496a-8d9f-d8a9f03cbd6b req-a46f05a1-aab7-421e-9c96-51319b89fe94 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:48:11 user nova-compute[74295]: WARNING nova.compute.manager [req-283eb14b-3014-496a-8d9f-d8a9f03cbd6b req-a46f05a1-aab7-421e-9c96-51319b89fe94 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state stopped and task_state None.
Oct 26 06:48:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-61f27c31-a3ba-4575-9b0b-b0dc92162745 req-76d36ac5-cc48-4e37-9ab9-8e94f4abce94 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received event network-changed-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-61f27c31-a3ba-4575-9b0b-b0dc92162745 req-76d36ac5-cc48-4e37-9ab9-8e94f4abce94 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Refreshing instance network info cache due to event network-changed-11e82fed-031c-4ae0-afea-9a2b44a6bbd9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:48:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-61f27c31-a3ba-4575-9b0b-b0dc92162745 req-76d36ac5-cc48-4e37-9ab9-8e94f4abce94 service nova] Acquiring lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:48:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-61f27c31-a3ba-4575-9b0b-b0dc92162745 req-76d36ac5-cc48-4e37-9ab9-8e94f4abce94 service nova] Acquired lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:48:14 user nova-compute[74295]: DEBUG nova.network.neutron [req-61f27c31-a3ba-4575-9b0b-b0dc92162745 req-76d36ac5-cc48-4e37-9ab9-8e94f4abce94 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Refreshing network info cache for port 11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:48:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:14 user nova-compute[74295]: DEBUG nova.network.neutron [req-61f27c31-a3ba-4575-9b0b-b0dc92162745 req-76d36ac5-cc48-4e37-9ab9-8e94f4abce94 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Updated VIF entry in instance network info cache for port 11e82fed-031c-4ae0-afea-9a2b44a6bbd9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:48:14 user nova-compute[74295]: DEBUG nova.network.neutron [req-61f27c31-a3ba-4575-9b0b-b0dc92162745 req-76d36ac5-cc48-4e37-9ab9-8e94f4abce94 service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Updating instance_info_cache with network_info: [{"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:48:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-61f27c31-a3ba-4575-9b0b-b0dc92162745 req-76d36ac5-cc48-4e37-9ab9-8e94f4abce94 service nova] Releasing lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:48:16 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:20 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:48:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lazy-loading 'flavor' on Instance uuid c00e8840-1c48-465b-b611-d9c05339de35 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:22 user nova-compute[74295]: INFO nova.compute.manager [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Attaching volume 64dd6e75-fff6-417a-869a-b67f33e1cb06 to /dev/vdb
Oct 26 06:48:22 user nova-compute[74295]: DEBUG os_brick.utils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[744345d2-4b63-4dbf-82a8-1c29f93b38ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d44c4-a667-4e0b-9ae1-0b850c3bd5d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7b57d3-e8ce-46e0-8573-6514a5ccc86c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a50db8d-b7f5-47e0-bded-cb70f2fabc0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:48:22 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7bda56-0a2a-45be-a174-58ea223e1cff]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG os_brick.utils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] <== get_connector_properties: return (517ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Updating existing volume attachment record: c2ce59ae-369a-4365-9281-3c84c12dcd2a {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:48:22 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:48:22 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:48:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8095MB free_disk=25.229434967041016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b7eba875-99ff-4eff-b2fc-d053c999cac5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c00e8840-1c48-465b-b611-d9c05339de35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cfde0bac-90db-40c0-90c6-957b2baf948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 440fb9b0-8413-4576-b61f-5f66b1122e9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:48:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.766s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:24 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:24 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:48:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:48:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:48:24 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:48:25 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Updating instance_info_cache with network_info: [{"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:48:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-b7eba875-99ff-4eff-b2fc-d053c999cac5" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:48:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:48:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:48:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:48:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:48:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnuwklcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:48:41 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:48:41 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:48:41 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b16b9e6-d496-4eaf-ac94-5262b4eed25a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:48:41 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac981544-b2d2-492d-8e07-56faced7b604]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06] added
Oct 26 06:48:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[820b243f-6d8a-4861-8194-5396f738e968]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8accbee-b3a6-4743-954f-a4d6e1cc600b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnuwklcG {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnuwklcG" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4de0b3-186c-4c0d-839f-8dc30fdd429d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OnuwklcG'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b51980-89cc-4eae-b3e3-170a871109b5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[724ac33e-2cc9-443d-b5ea-efaa6c4257a5]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[687e8d97-b8e1-4f44-b037-2ff4efe75849]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06, portal: 172.16.0.220,3260]
Oct 26 06:48:41 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06, portal: 172.16.0.220,3260] successful.
Oct 26 06:48:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f7f4eb-c280-4973-b5c2-45d61fa19489]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad33d3f1-91c3-4102-a32e-9a43afc7b9ce]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 (non-flash)
Oct 26 06:48:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65f233b-f656-41f9-8e96-052250687427]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:48:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:42 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:48:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnuwklcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:48:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:48:42 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23065316132303633', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:48:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065316132303633', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:48:42 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lazy-loading 'flavor' on Instance uuid c00e8840-1c48-465b-b611-d9c05339de35 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:48:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:48:43 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:48:43 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:48:43 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:48:43 user nova-compute[74295]:   <serial>64dd6e75-fff6-417a-869a-b67f33e1cb06</serial>
Oct 26 06:48:43 user nova-compute[74295]: </disk>
Oct 26 06:48:43 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:48:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:48:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:48:43 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] No VIF found with MAC fa:16:3e:6d:2b:12, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:48:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1c5b37e7-1ea7-485c-ab26-e8a3e3fa5eb4 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.206s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:44 user nova-compute[74295]: INFO nova.compute.manager [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Detaching volume 64dd6e75-fff6-417a-869a-b67f33e1cb06
Oct 26 06:48:45 user nova-compute[74295]: INFO nova.virt.block_device [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Attempting to driver detach volume 64dd6e75-fff6-417a-869a-b67f33e1cb06 from mountpoint /dev/vdb
Oct 26 06:48:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Attempting to detach device vdb from instance c00e8840-1c48-465b-b611-d9c05339de35 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:48:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:48:45 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:48:45 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:48:45 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:48:45 user nova-compute[74295]:   <serial>64dd6e75-fff6-417a-869a-b67f33e1cb06</serial>
Oct 26 06:48:45 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:48:45 user nova-compute[74295]: </disk>
Oct 26 06:48:45 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:48:45 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Successfully detached device vdb from instance c00e8840-1c48-465b-b611-d9c05339de35 from the persistent domain config.
Oct 26 06:48:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c00e8840-1c48-465b-b611-d9c05339de35 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:48:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:48:45 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:48:45 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:48:45 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:48:45 user nova-compute[74295]:   <serial>64dd6e75-fff6-417a-869a-b67f33e1cb06</serial>
Oct 26 06:48:45 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:48:45 user nova-compute[74295]: </disk>
Oct 26 06:48:45 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:48:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c00e8840-1c48-465b-b611-d9c05339de35 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:48:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-022bc019-0bbd-4cde-8c48-3fdc2c64a92f req-0a4af895-5b59-4c3b-8347-3d6bea7f2b5b service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-changed-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-022bc019-0bbd-4cde-8c48-3fdc2c64a92f req-0a4af895-5b59-4c3b-8347-3d6bea7f2b5b service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Refreshing instance network info cache due to event network-changed-76720f8b-41b5-44f4-b4d3-5f501b977acb. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:48:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-022bc019-0bbd-4cde-8c48-3fdc2c64a92f req-0a4af895-5b59-4c3b-8347-3d6bea7f2b5b service nova] Acquiring lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:48:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-022bc019-0bbd-4cde-8c48-3fdc2c64a92f req-0a4af895-5b59-4c3b-8347-3d6bea7f2b5b service nova] Acquired lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:48:48 user nova-compute[74295]: DEBUG nova.network.neutron [req-022bc019-0bbd-4cde-8c48-3fdc2c64a92f req-0a4af895-5b59-4c3b-8347-3d6bea7f2b5b service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Refreshing network info cache for port 76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:48:48 user nova-compute[74295]: DEBUG nova.network.neutron [req-022bc019-0bbd-4cde-8c48-3fdc2c64a92f req-0a4af895-5b59-4c3b-8347-3d6bea7f2b5b service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updated VIF entry in instance network info cache for port 76720f8b-41b5-44f4-b4d3-5f501b977acb. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:48:48 user nova-compute[74295]: DEBUG nova.network.neutron [req-022bc019-0bbd-4cde-8c48-3fdc2c64a92f req-0a4af895-5b59-4c3b-8347-3d6bea7f2b5b service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating instance_info_cache with network_info: [{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:48:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-022bc019-0bbd-4cde-8c48-3fdc2c64a92f req-0a4af895-5b59-4c3b-8347-3d6bea7f2b5b service nova] Releasing lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:48:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-0a46656f-3d46-46b8-80f8-b6d28ea3d277 req-d9b02bbc-f5ed-4a20-8292-f634d3232630 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received event network-changed-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-0a46656f-3d46-46b8-80f8-b6d28ea3d277 req-d9b02bbc-f5ed-4a20-8292-f634d3232630 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Refreshing instance network info cache due to event network-changed-22be2713-662e-438d-852d-3946776cd2e8. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0a46656f-3d46-46b8-80f8-b6d28ea3d277 req-d9b02bbc-f5ed-4a20-8292-f634d3232630 service nova] Acquiring lock "refresh_cache-e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0a46656f-3d46-46b8-80f8-b6d28ea3d277 req-d9b02bbc-f5ed-4a20-8292-f634d3232630 service nova] Acquired lock "refresh_cache-e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-0a46656f-3d46-46b8-80f8-b6d28ea3d277 req-d9b02bbc-f5ed-4a20-8292-f634d3232630 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Refreshing network info cache for port 22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-0a46656f-3d46-46b8-80f8-b6d28ea3d277 req-d9b02bbc-f5ed-4a20-8292-f634d3232630 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Updated VIF entry in instance network info cache for port 22be2713-662e-438d-852d-3946776cd2e8. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-0a46656f-3d46-46b8-80f8-b6d28ea3d277 req-d9b02bbc-f5ed-4a20-8292-f634d3232630 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Updating instance_info_cache with network_info: [{"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0a46656f-3d46-46b8-80f8-b6d28ea3d277 req-d9b02bbc-f5ed-4a20-8292-f634d3232630 service nova] Releasing lock "refresh_cache-e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:52 user nova-compute[74295]: INFO nova.compute.manager [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Terminating instance
Oct 26 06:48:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:53 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Instance destroyed successfully.
Oct 26 06:48:53 user nova-compute[74295]: DEBUG nova.objects.instance [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'resources' on Instance uuid e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1968305290',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1968305290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1968305290',id=38,image_ref='074140e5-ca38-44a8-a27f-6d5541282376',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq4qtH0WI59Dseojk49lCfQzxCmOFGUGT6TSmr13cj5uKakXTiTkO4ZIkMVDq8Bl6ZnPtWOE/iimXJWyehuxgRLw1f+ouRChN1OVDYlFXmVFm2PwD5S85Pw4rmBI7c8KA==',key_name='tempest-keypair-976332101',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:47:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-ac38t07d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-594294549',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:47:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "22be2713-662e-438d-852d-3946776cd2e8", "address": "fa:16:3e:bc:ef:77", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22be2713-66", "ovs_interfaceid": "22be2713-662e-438d-852d-3946776cd2e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ef:77,bridge_name='br-int',has_traffic_filtering=True,id=22be2713-662e-438d-852d-3946776cd2e8,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be2713-66') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_vif [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ef:77,bridge_name='br-int',has_traffic_filtering=True,id=22be2713-662e-438d-852d-3946776cd2e8,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be2713-66') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22be2713-66, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3bb34d5-0571-421d-84ed-ca308b91a321) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:53 user nova-compute[74295]: INFO os_vif [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ef:77,bridge_name='br-int',has_traffic_filtering=True,id=22be2713-662e-438d-852d-3946776cd2e8,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22be2713-66')
Oct 26 06:48:53 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWLbfZkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:48:53 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39cc830-1077-402b-a47b-e86caf96d0f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:48:53 user nova-compute[74295]: No targets found.
Oct 26 06:48:53 user nova-compute[74295]: iSNS:
Oct 26 06:48:53 user nova-compute[74295]: No targets found.
Oct 26 06:48:53 user nova-compute[74295]: STATIC:
Oct 26 06:48:53 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0
Oct 26 06:48:53 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:48:53 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:48:53 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1
Oct 26 06:48:53 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:48:53 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:48:53 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06
Oct 26 06:48:53 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:48:53 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:48:53 user nova-compute[74295]: FIRMWARE:
Oct 26 06:48:53 user nova-compute[74295]: No targets found.
Oct 26 06:48:53 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:48:53 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:48:53 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8605ec-e31c-42cd-8814-746ab065e9f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bc59b5-3a42-4a33-8689-adb96fdd4d8a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:48:53 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:48:53 user nova-compute[74295]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 (non-flash)
Oct 26 06:48:53 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:48:53 user nova-compute[74295]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 (non-flash)
Oct 26 06:48:53 user nova-compute[74295]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 (non-flash)
Oct 26 06:48:53 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac569e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd529f34-88af-4d63-9a93-bc87591eb22f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[34335e49-2714-4d62-8259-6fe76154db17]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aba547d-ce03-46e8-a4c0-098b6cbd4036]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:48:53 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00fa775-eb80-4627-88c7-5c4e8ff4a635]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdab97f-4871-42fe-9bce-c6c5d7fc567a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c924a6-65e5-4d66-bae7-6f474ca65b39]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1, portal: 172.16.0.220,3260]
Oct 26 06:48:54 user nova-compute[74295]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1, portal: 172.16.0.220,3260] successful.
Oct 26 06:48:54 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b8b2f-29ff-40c2-b9d0-567d072af540]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== disconnect_volume: return (338ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:48:54 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Deleting instance files /opt/stack/data/nova/instances/e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e_del
Oct 26 06:48:54 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Deletion of /opt/stack/data/nova/instances/e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e_del complete
Oct 26 06:48:54 user nova-compute[74295]: INFO nova.compute.manager [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received event network-vif-unplugged-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] Acquiring lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] No waiting events found dispatching network-vif-unplugged-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received event network-vif-unplugged-22be2713-662e-438d-852d-3946776cd2e8 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received event network-vif-plugged-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] Acquiring lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] No waiting events found dispatching network-vif-plugged-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:48:54 user nova-compute[74295]: WARNING nova.compute.manager [req-56533947-1886-4038-ac8b-cdae20f258fe req-6f0fa759-cff2-4b61-b55f-0a5ad87b4fc5 service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received unexpected event network-vif-plugged-22be2713-662e-438d-852d-3946776cd2e8 for instance with vm_state active and task_state deleting.
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:48:54 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Took 0.67 seconds to deallocate network for instance.
Oct 26 06:48:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-65ea83b6-ea32-4724-b9c5-7c8008e390ee req-50809107-6a75-4791-b98e-8f6b3e8c1d3b service nova] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Received event network-vif-deleted-22be2713-662e-438d-852d-3946776cd2e8 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:55 user nova-compute[74295]: INFO nova.compute.manager [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Shelving
Oct 26 06:48:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-6594e44b-6945-444d-94b8-ad878c8b91ca req-fefc6d1e-2410-424f-ac7b-5f54e323a21d service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-unplugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6594e44b-6945-444d-94b8-ad878c8b91ca req-fefc6d1e-2410-424f-ac7b-5f54e323a21d service nova] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6594e44b-6945-444d-94b8-ad878c8b91ca req-fefc6d1e-2410-424f-ac7b-5f54e323a21d service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6594e44b-6945-444d-94b8-ad878c8b91ca req-fefc6d1e-2410-424f-ac7b-5f54e323a21d service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG nova.compute.manager [req-6594e44b-6945-444d-94b8-ad878c8b91ca req-fefc6d1e-2410-424f-ac7b-5f54e323a21d service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] No waiting events found dispatching network-vif-unplugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:48:55 user nova-compute[74295]: WARNING nova.compute.manager [req-6594e44b-6945-444d-94b8-ad878c8b91ca req-fefc6d1e-2410-424f-ac7b-5f54e323a21d service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received unexpected event network-vif-unplugged-76720f8b-41b5-44f4-b4d3-5f501b977acb for instance with vm_state active and task_state shelving.
Oct 26 06:48:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:55 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance destroyed successfully.
Oct 26 06:48:55 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Beginning cold snapshot process
Oct 26 06:48:55 user nova-compute[74295]: INFO nova.compute.manager [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Took 0.92 seconds to detach 1 volumes for instance.
Oct 26 06:48:55 user nova-compute[74295]: DEBUG nova.compute.manager [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e] Deleting volume: fd64a0c1-55a5-49ea-9adb-f6ec2bcad7b1 {{(pid=74295) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:48:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk /opt/stack/data/nova/instances/snapshots/tmpeyxsaeo_/e00bdd25acb84d28b9ceeb69e8490190 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:48:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:56 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:48:56 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:48:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:56 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Deleted allocations for instance e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e
Oct 26 06:48:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk /opt/stack/data/nova/instances/snapshots/tmpeyxsaeo_/e00bdd25acb84d28b9ceeb69e8490190" returned: 0 in 0.799s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:48:56 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Snapshot extracted, beginning image upload
Oct 26 06:48:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-10a0f18a-500d-4e23-9aa2-78c35c0fc271 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "e10ea49e-ef2d-41fd-ac81-91a6d4cfbb6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.767s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-90d9eb2a-d15b-42b2-9c7e-b28833e34b3b req-e6e32df7-248b-4aa5-9ac6-75d749ddeca4 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:48:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-90d9eb2a-d15b-42b2-9c7e-b28833e34b3b req-e6e32df7-248b-4aa5-9ac6-75d749ddeca4 service nova] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:48:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-90d9eb2a-d15b-42b2-9c7e-b28833e34b3b req-e6e32df7-248b-4aa5-9ac6-75d749ddeca4 service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:48:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-90d9eb2a-d15b-42b2-9c7e-b28833e34b3b req-e6e32df7-248b-4aa5-9ac6-75d749ddeca4 service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:48:57 user nova-compute[74295]: DEBUG nova.compute.manager [req-90d9eb2a-d15b-42b2-9c7e-b28833e34b3b req-e6e32df7-248b-4aa5-9ac6-75d749ddeca4 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] No waiting events found dispatching network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:48:57 user nova-compute[74295]: WARNING nova.compute.manager [req-90d9eb2a-d15b-42b2-9c7e-b28833e34b3b req-e6e32df7-248b-4aa5-9ac6-75d749ddeca4 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received unexpected event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 06:48:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:48:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Snapshot image upload complete
Oct 26 06:48:59 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:48:59 user nova-compute[74295]: INFO nova.compute.manager [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Shelve offloading
Oct 26 06:48:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance destroyed successfully.
Oct 26 06:48:59 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:48:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:48:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquired lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:48:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:48:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating instance_info_cache with network_info: [{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:48:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Releasing lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:49:00 user nova-compute[74295]: INFO nova.compute.claims [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Claim successful on node user
Oct 26 06:49:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance destroyed successfully.
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'resources' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1987518129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1987518129',id=37,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhL+j1T2jaZDC4siRAiEALDqrNUrSEv5SOAEBUZRHM+o0/6cDlpz+0XtUCGyQJ5Xl0GFgf4wERK7g7yCmcEqhT2OqWWJo1Fwa55ObRVj+BtaPs8U4pJbdlsGqYGYA85qA==',key_name='tempest-keypair-52913859',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-432f93yk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member',shelved_at='2023-10-26T06:48:59.191335',shelved_host='user',shelved_image_id='4fe17822-4e64-43b0-b856-dd5bc3587cd6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=cfde0bac-90db-40c0-90c6-957b2baf948c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG os_vif [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-b1b8a018-4145-4979-8326-65b03f4785c7 req-4663c833-bdf8-4507-bfe4-688bb7ba0bd8 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-changed-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-b1b8a018-4145-4979-8326-65b03f4785c7 req-4663c833-bdf8-4507-bfe4-688bb7ba0bd8 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Refreshing instance network info cache due to event network-changed-76720f8b-41b5-44f4-b4d3-5f501b977acb. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b1b8a018-4145-4979-8326-65b03f4785c7 req-4663c833-bdf8-4507-bfe4-688bb7ba0bd8 service nova] Acquiring lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b1b8a018-4145-4979-8326-65b03f4785c7 req-4663c833-bdf8-4507-bfe4-688bb7ba0bd8 service nova] Acquired lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-b1b8a018-4145-4979-8326-65b03f4785c7 req-4663c833-bdf8-4507-bfe4-688bb7ba0bd8 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Refreshing network info cache for port 76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76720f8b-41, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6c0b0ea-c2c7-4d18-a45f-0926be2167c6) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:00 user nova-compute[74295]: INFO os_vif [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41')
Oct 26 06:49:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Deleting instance files /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c_del
Oct 26 06:49:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Deletion of /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c_del complete
Oct 26 06:49:00 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Deleted allocations for instance cfde0bac-90db-40c0-90c6-957b2baf948c
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.030s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'numa_topology' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.objects.base [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<cfde0bac-90db-40c0-90c6-957b2baf948c> lazy-loaded attributes: resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.network.neutron [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:49:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.policy [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01f2b3710476458abc998271a7047156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43980edd6fd428a94283c56a896d717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-b1b8a018-4145-4979-8326-65b03f4785c7 req-4663c833-bdf8-4507-bfe4-688bb7ba0bd8 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updated VIF entry in instance network info cache for port 76720f8b-41b5-44f4-b4d3-5f501b977acb. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.network.neutron [req-b1b8a018-4145-4979-8326-65b03f4785c7 req-4663c833-bdf8-4507-bfe4-688bb7ba0bd8 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating instance_info_cache with network_info: [{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap76720f8b-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b1b8a018-4145-4979-8326-65b03f4785c7 req-4663c833-bdf8-4507-bfe4-688bb7ba0bd8 service nova] Releasing lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:49:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Creating image(s)
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "/opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "/opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a9bb8c67-eb8e-45c0-abae-f41945561e7a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.880s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk 1073741824" returned: 0 in 0.057s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG nova.network.neutron [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Successfully created port: 43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Cannot resize image /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Ensure instance console log exists: /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Successfully updated port: 43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "refresh_cache-ac34132a-3908-4cc8-b65f-bc2ed005ccf6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquired lock "refresh_cache-ac34132a-3908-4cc8-b65f-bc2ed005ccf6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-4b362b72-b140-40ca-8b60-c5553c556c9e req-87389d7b-a5f6-4165-adba-9a2412139fce service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received event network-changed-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-4b362b72-b140-40ca-8b60-c5553c556c9e req-87389d7b-a5f6-4165-adba-9a2412139fce service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Refreshing instance network info cache due to event network-changed-43c1cebd-71b0-4cf9-bc83-a5c15667c63b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4b362b72-b140-40ca-8b60-c5553c556c9e req-87389d7b-a5f6-4165-adba-9a2412139fce service nova] Acquiring lock "refresh_cache-ac34132a-3908-4cc8-b65f-bc2ed005ccf6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.network.neutron [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Updating instance_info_cache with network_info: [{"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Releasing lock "refresh_cache-ac34132a-3908-4cc8-b65f-bc2ed005ccf6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Instance network_info: |[{"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4b362b72-b140-40ca-8b60-c5553c556c9e req-87389d7b-a5f6-4165-adba-9a2412139fce service nova] Acquired lock "refresh_cache-ac34132a-3908-4cc8-b65f-bc2ed005ccf6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.network.neutron [req-4b362b72-b140-40ca-8b60-c5553c556c9e req-87389d7b-a5f6-4165-adba-9a2412139fce service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Refreshing network info cache for port 43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Start _get_guest_xml network_info=[{"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:49:02 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:49:02 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-570857666',display_name='tempest-VolumesSnapshotTestJSON-instance-570857666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-570857666',id=40,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/c+989snAmr7cDlzc3w+k3zvnIJuRYeTB9ABhWdyywZ7s/K+bgtxrNZh0mOA65jVgpt9CXTnDwS8rcAKWXcRtDVTKfQzbEcz0DbGcmG/mqDUUt4GVwYxlVcr8TBbBWuA==',key_name='tempest-keypair-1476096408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43980edd6fd428a94283c56a896d717',ramdisk_id='',reservation_id='r-bg0m5j16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1927708355',owner_user_name='tempest-VolumesSnapshotTestJSON-1927708355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01f2b3710476458abc998271a7047156',uuid=ac34132a-3908-4cc8-b65f-bc2ed005ccf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converting VIF {"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a0:9b,bridge_name='br-int',has_traffic_filtering=True,id=43c1cebd-71b0-4cf9-bc83-a5c15667c63b,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c1cebd-71') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.objects.instance [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'pci_devices' on Instance uuid ac34132a-3908-4cc8-b65f-bc2ed005ccf6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:49:02 user nova-compute[74295]:   <uuid>ac34132a-3908-4cc8-b65f-bc2ed005ccf6</uuid>
Oct 26 06:49:02 user nova-compute[74295]:   <name>instance-00000028</name>
Oct 26 06:49:02 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:49:02 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:49:02 user nova-compute[74295]:   <metadata>
Oct 26 06:49:02 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:49:02 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:49:02 user nova-compute[74295]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-570857666</nova:name>
Oct 26 06:49:02 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:49:02</nova:creationTime>
Oct 26 06:49:02 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:49:02 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:49:02 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:49:02 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:49:02 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:49:02 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:49:02 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:49:02 user nova-compute[74295]:       <nova:owner>
Oct 26 06:49:02 user nova-compute[74295]:         <nova:user uuid="01f2b3710476458abc998271a7047156">tempest-VolumesSnapshotTestJSON-1927708355-project-member</nova:user>
Oct 26 06:49:02 user nova-compute[74295]:         <nova:project uuid="b43980edd6fd428a94283c56a896d717">tempest-VolumesSnapshotTestJSON-1927708355</nova:project>
Oct 26 06:49:02 user nova-compute[74295]:       </nova:owner>
Oct 26 06:49:02 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:49:02 user nova-compute[74295]:       <nova:ports>
Oct 26 06:49:02 user nova-compute[74295]:         <nova:port uuid="43c1cebd-71b0-4cf9-bc83-a5c15667c63b">
Oct 26 06:49:02 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 06:49:02 user nova-compute[74295]:         </nova:port>
Oct 26 06:49:02 user nova-compute[74295]:       </nova:ports>
Oct 26 06:49:02 user nova-compute[74295]:     </nova:instance>
Oct 26 06:49:02 user nova-compute[74295]:   </metadata>
Oct 26 06:49:02 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:49:02 user nova-compute[74295]:     <system>
Oct 26 06:49:02 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:49:02 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:49:02 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:49:02 user nova-compute[74295]:       <entry name="serial">ac34132a-3908-4cc8-b65f-bc2ed005ccf6</entry>
Oct 26 06:49:02 user nova-compute[74295]:       <entry name="uuid">ac34132a-3908-4cc8-b65f-bc2ed005ccf6</entry>
Oct 26 06:49:02 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:49:02 user nova-compute[74295]:     </system>
Oct 26 06:49:02 user nova-compute[74295]:   </sysinfo>
Oct 26 06:49:02 user nova-compute[74295]:   <os>
Oct 26 06:49:02 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:49:02 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:49:02 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:49:02 user nova-compute[74295]:   </os>
Oct 26 06:49:02 user nova-compute[74295]:   <features>
Oct 26 06:49:02 user nova-compute[74295]:     <acpi/>
Oct 26 06:49:02 user nova-compute[74295]:     <apic/>
Oct 26 06:49:02 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:49:02 user nova-compute[74295]:   </features>
Oct 26 06:49:02 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:49:02 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:49:02 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:49:02 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:49:02 user nova-compute[74295]:   </clock>
Oct 26 06:49:02 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:49:02 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:49:02 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:49:02 user nova-compute[74295]:   </cpu>
Oct 26 06:49:02 user nova-compute[74295]:   <devices>
Oct 26 06:49:02 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:49:02 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:49:02 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk"/>
Oct 26 06:49:02 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:49:02 user nova-compute[74295]:     </disk>
Oct 26 06:49:02 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:49:02 user nova-compute[74295]:       <mac address="fa:16:3e:98:a0:9b"/>
Oct 26 06:49:02 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:49:02 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:49:02 user nova-compute[74295]:       <target dev="tap43c1cebd-71"/>
Oct 26 06:49:02 user nova-compute[74295]:     </interface>
Oct 26 06:49:02 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:49:02 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/console.log" append="off"/>
Oct 26 06:49:02 user nova-compute[74295]:     </serial>
Oct 26 06:49:02 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:49:02 user nova-compute[74295]:     <video>
Oct 26 06:49:02 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:49:02 user nova-compute[74295]:     </video>
Oct 26 06:49:02 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:49:02 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:49:02 user nova-compute[74295]:     </rng>
Oct 26 06:49:02 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:49:02 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:49:02 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:49:02 user nova-compute[74295]:     </memballoon>
Oct 26 06:49:02 user nova-compute[74295]:   </devices>
Oct 26 06:49:02 user nova-compute[74295]: </domain>
Oct 26 06:49:02 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-570857666',display_name='tempest-VolumesSnapshotTestJSON-instance-570857666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-570857666',id=40,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/c+989snAmr7cDlzc3w+k3zvnIJuRYeTB9ABhWdyywZ7s/K+bgtxrNZh0mOA65jVgpt9CXTnDwS8rcAKWXcRtDVTKfQzbEcz0DbGcmG/mqDUUt4GVwYxlVcr8TBbBWuA==',key_name='tempest-keypair-1476096408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43980edd6fd428a94283c56a896d717',ramdisk_id='',reservation_id='r-bg0m5j16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1927708355',owner_user_name='tempest-VolumesSnapshotTestJSON-1927708355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01f2b3710476458abc998271a7047156',uuid=ac34132a-3908-4cc8-b65f-bc2ed005ccf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converting VIF {"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a0:9b,bridge_name='br-int',has_traffic_filtering=True,id=43c1cebd-71b0-4cf9-bc83-a5c15667c63b,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c1cebd-71') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG os_vif [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a0:9b,bridge_name='br-int',has_traffic_filtering=True,id=43c1cebd-71b0-4cf9-bc83-a5c15667c63b,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c1cebd-71') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b48c478-b986-5427-be6f-5b11cf191955', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43c1cebd-71, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43c1cebd-71, col_values=(('qos', UUID('cfcd3333-7ee7-43b3-b620-593f6399f613')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43c1cebd-71, col_values=(('external_ids', {'iface-id': '43c1cebd-71b0-4cf9-bc83-a5c15667c63b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:a0:9b', 'vm-uuid': 'ac34132a-3908-4cc8-b65f-bc2ed005ccf6'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:02 user nova-compute[74295]: INFO os_vif [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a0:9b,bridge_name='br-int',has_traffic_filtering=True,id=43c1cebd-71b0-4cf9-bc83-a5c15667c63b,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c1cebd-71')
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:49:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No VIF found with MAC fa:16:3e:98:a0:9b, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:49:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-4b362b72-b140-40ca-8b60-c5553c556c9e req-87389d7b-a5f6-4165-adba-9a2412139fce service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Updated VIF entry in instance network info cache for port 43c1cebd-71b0-4cf9-bc83-a5c15667c63b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:49:03 user nova-compute[74295]: DEBUG nova.network.neutron [req-4b362b72-b140-40ca-8b60-c5553c556c9e req-87389d7b-a5f6-4165-adba-9a2412139fce service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Updating instance_info_cache with network_info: [{"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:49:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4b362b72-b140-40ca-8b60-c5553c556c9e req-87389d7b-a5f6-4165-adba-9a2412139fce service nova] Releasing lock "refresh_cache-ac34132a-3908-4cc8-b65f-bc2ed005ccf6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:49:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-8486e946-a9b8-49c7-addf-388453962109 req-af487cc6-93f6-41da-a528-0fc81eb6d9a1 service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received event network-vif-plugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8486e946-a9b8-49c7-addf-388453962109 req-af487cc6-93f6-41da-a528-0fc81eb6d9a1 service nova] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8486e946-a9b8-49c7-addf-388453962109 req-af487cc6-93f6-41da-a528-0fc81eb6d9a1 service nova] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8486e946-a9b8-49c7-addf-388453962109 req-af487cc6-93f6-41da-a528-0fc81eb6d9a1 service nova] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:04 user nova-compute[74295]: DEBUG nova.compute.manager [req-8486e946-a9b8-49c7-addf-388453962109 req-af487cc6-93f6-41da-a528-0fc81eb6d9a1 service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] No waiting events found dispatching network-vif-plugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:04 user nova-compute[74295]: WARNING nova.compute.manager [req-8486e946-a9b8-49c7-addf-388453962109 req-af487cc6-93f6-41da-a528-0fc81eb6d9a1 service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received unexpected event network-vif-plugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b for instance with vm_state building and task_state spawning.
Oct 26 06:49:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:05 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c00e8840-1c48-465b-b611-d9c05339de35 is timed out.
Oct 26 06:49:05 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Successfully detached device vdb from instance c00e8840-1c48-465b-b611-d9c05339de35 from the live domain config.
Oct 26 06:49:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnuwklcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:49:05 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f79212e-b052-4d74-98a0-736bb6ffad46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:49:05 user nova-compute[74295]: No targets found.
Oct 26 06:49:05 user nova-compute[74295]: iSNS:
Oct 26 06:49:05 user nova-compute[74295]: No targets found.
Oct 26 06:49:05 user nova-compute[74295]: STATIC:
Oct 26 06:49:05 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0
Oct 26 06:49:05 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:49:05 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:49:05 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06
Oct 26 06:49:05 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:49:05 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:49:05 user nova-compute[74295]: FIRMWARE:
Oct 26 06:49:05 user nova-compute[74295]: No targets found.
Oct 26 06:49:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:49:05 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:49:05 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778b0d0-9fb8-4f20-a6e3-a369135c5d05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f02adfd-a22f-4ba3-b598-a2f1cdcc06fd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:49:05 user nova-compute[74295]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 (non-flash)
Oct 26 06:49:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:49:05 user nova-compute[74295]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 (non-flash)
Oct 26 06:49:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35b40adc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9681947d-a114-405d-af3c-c1e1bc310a7e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c17134e-038f-4569-b1db-44002180fa8b]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab78837-008e-48c2-8864-0a1cad91fdb6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c57124b-5df7-4f0a-9f8f-cf6c0ade9342]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e7c2c6-3633-497b-9311-32348c58993e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e356169c-4949-42c6-a5d4-f86772dd1c53]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06, portal: 172.16.0.220,3260]
Oct 26 06:49:05 user nova-compute[74295]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06, portal: 172.16.0.220,3260] successful.
Oct 26 06:49:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64dd6e75-fff6-417a-869a-b67f33e1cb06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea4d87e-5970-4d0c-90e3-517df0aad621]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] <== disconnect_volume: return (310ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:49:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:49:06 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Instance spawned successfully.
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:49:06 user nova-compute[74295]: INFO nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Took 5.46 seconds to spawn the instance on the hypervisor.
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-c75c9abb-bb80-4b51-92a5-088d75e5a687 req-fdb5388e-1795-400a-b806-3e93a5774acb service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received event network-vif-plugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c75c9abb-bb80-4b51-92a5-088d75e5a687 req-fdb5388e-1795-400a-b806-3e93a5774acb service nova] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c75c9abb-bb80-4b51-92a5-088d75e5a687 req-fdb5388e-1795-400a-b806-3e93a5774acb service nova] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c75c9abb-bb80-4b51-92a5-088d75e5a687 req-fdb5388e-1795-400a-b806-3e93a5774acb service nova] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.compute.manager [req-c75c9abb-bb80-4b51-92a5-088d75e5a687 req-fdb5388e-1795-400a-b806-3e93a5774acb service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] No waiting events found dispatching network-vif-plugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:06 user nova-compute[74295]: WARNING nova.compute.manager [req-c75c9abb-bb80-4b51-92a5-088d75e5a687 req-fdb5388e-1795-400a-b806-3e93a5774acb service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received unexpected event network-vif-plugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b for instance with vm_state building and task_state spawning.
Oct 26 06:49:06 user nova-compute[74295]: INFO nova.compute.manager [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Took 6.24 seconds to build instance.
Oct 26 06:49:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-28e8b2ee-6364-4da8-93cc-2afb0d943456 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.398s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG nova.objects.instance [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lazy-loading 'flavor' on Instance uuid c00e8840-1c48-465b-b611-d9c05339de35 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:49:06 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-57c93dbe-53ef-46ad-8c9c-dc3ba957cd8f tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.791s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:49:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:49:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:49:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:17 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:49:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:49:20 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:49:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:20 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:49:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:22 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:49:22 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8238MB free_disk=25.16927719116211GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b7eba875-99ff-4eff-b2fc-d053c999cac5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c00e8840-1c48-465b-b611-d9c05339de35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 440fb9b0-8413-4576-b61f-5f66b1122e9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:49:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:49:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:49:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:49:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:49:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:49:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:49:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:49:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:49:25 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:49:26 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Updating instance_info_cache with network_info: [{"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:49:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-c00e8840-1c48-465b-b611-d9c05339de35" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:49:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:49:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:49:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:49:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:46 user nova-compute[74295]: INFO nova.compute.manager [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Terminating instance
Oct 26 06:49:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-3ce682be-dd84-4390-b31f-e679828a87a3 req-fd4e95d0-2382-4479-9042-96b04174ff6d service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received event network-vif-unplugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3ce682be-dd84-4390-b31f-e679828a87a3 req-fd4e95d0-2382-4479-9042-96b04174ff6d service nova] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3ce682be-dd84-4390-b31f-e679828a87a3 req-fd4e95d0-2382-4479-9042-96b04174ff6d service nova] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3ce682be-dd84-4390-b31f-e679828a87a3 req-fd4e95d0-2382-4479-9042-96b04174ff6d service nova] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-3ce682be-dd84-4390-b31f-e679828a87a3 req-fd4e95d0-2382-4479-9042-96b04174ff6d service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] No waiting events found dispatching network-vif-unplugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG nova.compute.manager [req-3ce682be-dd84-4390-b31f-e679828a87a3 req-fd4e95d0-2382-4479-9042-96b04174ff6d service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received event network-vif-unplugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Instance destroyed successfully.
Oct 26 06:49:46 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lazy-loading 'resources' on Instance uuid c00e8840-1c48-465b-b611-d9c05339de35 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1786095175',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1786095175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1786095',id=36,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM5wnHsww8Ro7IKoRBhvEhtrc5tOy2FJ86Hx4OP/avYhl41y2aSbOZ44btl6OBsolnQnlOPZlOyNKMhD4t7BOXnrVPn+rlOsy8/W7u9uinmjgk1UzoMdsMo2cFSD7IKOw==',key_name='tempest-keypair-519104211',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:46:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2162840335747c09434fec98e36b92b',ramdisk_id='',reservation_id='r-ssp8rxi4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-713887727',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c6d1df97394e38b83ac8558e5807da',uuid=c00e8840-1c48-465b-b611-d9c05339de35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Converting VIF {"id": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "address": "fa:16:3e:6d:2b:12", "network": {"id": "38bb25d3-4c05-4324-8e11-f4460caa1bf7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-662207810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2162840335747c09434fec98e36b92b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e82fed-03", "ovs_interfaceid": "11e82fed-031c-4ae0-afea-9a2b44a6bbd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:2b:12,bridge_name='br-int',has_traffic_filtering=True,id=11e82fed-031c-4ae0-afea-9a2b44a6bbd9,network=Network(38bb25d3-4c05-4324-8e11-f4460caa1bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e82fed-03') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG os_vif [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:2b:12,bridge_name='br-int',has_traffic_filtering=True,id=11e82fed-031c-4ae0-afea-9a2b44a6bbd9,network=Network(38bb25d3-4c05-4324-8e11-f4460caa1bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e82fed-03') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11e82fed-03, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0b4e406-c54b-4ea4-aa8a-031c8929063d) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:46 user nova-compute[74295]: INFO os_vif [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:2b:12,bridge_name='br-int',has_traffic_filtering=True,id=11e82fed-031c-4ae0-afea-9a2b44a6bbd9,network=Network(38bb25d3-4c05-4324-8e11-f4460caa1bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e82fed-03')
Oct 26 06:49:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Deleting instance files /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35_del
Oct 26 06:49:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Deletion of /opt/stack/data/nova/instances/c00e8840-1c48-465b-b611-d9c05339de35_del complete
Oct 26 06:49:47 user nova-compute[74295]: INFO nova.compute.manager [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 26 06:49:47 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:49:47 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:49:47 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c00e8840-1c48-465b-b611-d9c05339de35] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:49:47 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:49:47 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Took 0.77 seconds to deallocate network for instance.
Oct 26 06:49:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:48 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:49:48 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:49:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:48 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Deleted allocations for instance c00e8840-1c48-465b-b611-d9c05339de35
Oct 26 06:49:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3ef34a89-4c1b-45fa-85a4-ff3f9ebff4c0 tempest-TestServerVolumeAttachScenarioOldVersion-713887727 tempest-TestServerVolumeAttachScenarioOldVersion-713887727-project-member] Lock "c00e8840-1c48-465b-b611-d9c05339de35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.203s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-3b8e18b9-fc36-4812-a4f0-c51c56af4b31 req-86881dec-85b1-4a7c-8d53-f3783d25a0be service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received event network-vif-plugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3b8e18b9-fc36-4812-a4f0-c51c56af4b31 req-86881dec-85b1-4a7c-8d53-f3783d25a0be service nova] Acquiring lock "c00e8840-1c48-465b-b611-d9c05339de35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3b8e18b9-fc36-4812-a4f0-c51c56af4b31 req-86881dec-85b1-4a7c-8d53-f3783d25a0be service nova] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3b8e18b9-fc36-4812-a4f0-c51c56af4b31 req-86881dec-85b1-4a7c-8d53-f3783d25a0be service nova] Lock "c00e8840-1c48-465b-b611-d9c05339de35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-3b8e18b9-fc36-4812-a4f0-c51c56af4b31 req-86881dec-85b1-4a7c-8d53-f3783d25a0be service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] No waiting events found dispatching network-vif-plugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:48 user nova-compute[74295]: WARNING nova.compute.manager [req-3b8e18b9-fc36-4812-a4f0-c51c56af4b31 req-86881dec-85b1-4a7c-8d53-f3783d25a0be service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received unexpected event network-vif-plugged-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 for instance with vm_state deleted and task_state None.
Oct 26 06:49:48 user nova-compute[74295]: DEBUG nova.compute.manager [req-3b8e18b9-fc36-4812-a4f0-c51c56af4b31 req-86881dec-85b1-4a7c-8d53-f3783d25a0be service nova] [instance: c00e8840-1c48-465b-b611-d9c05339de35] Received event network-vif-deleted-11e82fed-031c-4ae0-afea-9a2b44a6bbd9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:50 user nova-compute[74295]: INFO nova.compute.manager [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Terminating instance
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.compute.manager [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-44cf85ed-adf0-4cbd-b6b2-7ee54fc13e01 req-de502496-fede-4882-bf44-5e00c15e649e service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-unplugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-44cf85ed-adf0-4cbd-b6b2-7ee54fc13e01 req-de502496-fede-4882-bf44-5e00c15e649e service nova] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-44cf85ed-adf0-4cbd-b6b2-7ee54fc13e01 req-de502496-fede-4882-bf44-5e00c15e649e service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-44cf85ed-adf0-4cbd-b6b2-7ee54fc13e01 req-de502496-fede-4882-bf44-5e00c15e649e service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-44cf85ed-adf0-4cbd-b6b2-7ee54fc13e01 req-de502496-fede-4882-bf44-5e00c15e649e service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] No waiting events found dispatching network-vif-unplugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-44cf85ed-adf0-4cbd-b6b2-7ee54fc13e01 req-de502496-fede-4882-bf44-5e00c15e649e service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-unplugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Instance destroyed successfully.
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.objects.instance [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lazy-loading 'resources' on Instance uuid 440fb9b0-8413-4576-b61f-5f66b1122e9a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1342623309',display_name='tempest-VolumesActionsTest-instance-1342623309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1342623309',id=39,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d88a851e41145faa5bfb4957480ba60',ramdisk_id='',reservation_id='r-9dysopxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1373610269',owner_user_name='tempest-VolumesActionsTest-1373610269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:47:48Z,user_data=None,user_id='625bb2a8aabc4dc1a2f01e8971623312',uuid=440fb9b0-8413-4576-b61f-5f66b1122e9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Converting VIF {"id": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "address": "fa:16:3e:6d:99:11", "network": {"id": "83742bc8-eb2c-4e93-9cce-0ff55b3f44dc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2107341861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d88a851e41145faa5bfb4957480ba60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d5f56-a8", "ovs_interfaceid": "e39d5f56-a830-45c7-bfae-f8501e19ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:11,bridge_name='br-int',has_traffic_filtering=True,id=e39d5f56-a830-45c7-bfae-f8501e19ac16,network=Network(83742bc8-eb2c-4e93-9cce-0ff55b3f44dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d5f56-a8') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG os_vif [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:11,bridge_name='br-int',has_traffic_filtering=True,id=e39d5f56-a830-45c7-bfae-f8501e19ac16,network=Network(83742bc8-eb2c-4e93-9cce-0ff55b3f44dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d5f56-a8') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape39d5f56-a8, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f617fd9-77c5-426d-b33f-feb27936ced1) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: INFO os_vif [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:99:11,bridge_name='br-int',has_traffic_filtering=True,id=e39d5f56-a830-45c7-bfae-f8501e19ac16,network=Network(83742bc8-eb2c-4e93-9cce-0ff55b3f44dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d5f56-a8')
Oct 26 06:49:51 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Deleting instance files /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a_del
Oct 26 06:49:51 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Deletion of /opt/stack/data/nova/instances/440fb9b0-8413-4576-b61f-5f66b1122e9a_del complete
Oct 26 06:49:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:51 user nova-compute[74295]: INFO nova.compute.manager [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 26 06:49:51 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:49:51 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:49:52 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Took 0.70 seconds to deallocate network for instance.
Oct 26 06:49:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-b5e80bf9-4c90-472d-9811-b6456c924f1a req-630c9004-64f8-4748-b7aa-3753d3d0fd6e service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-deleted-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:52 user nova-compute[74295]: INFO nova.compute.manager [req-b5e80bf9-4c90-472d-9811-b6456c924f1a req-630c9004-64f8-4748-b7aa-3753d3d0fd6e service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Neutron deleted interface e39d5f56-a830-45c7-bfae-f8501e19ac16; detaching it from the instance and deleting it from the info cache
Oct 26 06:49:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-b5e80bf9-4c90-472d-9811-b6456c924f1a req-630c9004-64f8-4748-b7aa-3753d3d0fd6e service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-b5e80bf9-4c90-472d-9811-b6456c924f1a req-630c9004-64f8-4748-b7aa-3753d3d0fd6e service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Detach interface failed, port_id=e39d5f56-a830-45c7-bfae-f8501e19ac16, reason: Instance 440fb9b0-8413-4576-b61f-5f66b1122e9a could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:49:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:53 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Deleted allocations for instance 440fb9b0-8413-4576-b61f-5f66b1122e9a
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a8f669bf-1ba6-4281-acd0-7a25cadf6f28 tempest-VolumesActionsTest-1373610269 tempest-VolumesActionsTest-1373610269-project-member] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] No waiting events found dispatching network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:53 user nova-compute[74295]: WARNING nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received unexpected event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 for instance with vm_state deleted and task_state None.
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] No waiting events found dispatching network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:53 user nova-compute[74295]: WARNING nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received unexpected event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 for instance with vm_state deleted and task_state None.
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] No waiting events found dispatching network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:53 user nova-compute[74295]: WARNING nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received unexpected event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 for instance with vm_state deleted and task_state None.
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-unplugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] No waiting events found dispatching network-vif-unplugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:53 user nova-compute[74295]: WARNING nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received unexpected event network-vif-unplugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 for instance with vm_state deleted and task_state None.
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Acquiring lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] Lock "440fb9b0-8413-4576-b61f-5f66b1122e9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] No waiting events found dispatching network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:53 user nova-compute[74295]: WARNING nova.compute.manager [req-86fb0cd3-7c4b-416e-b287-564de24ab634 req-33b954de-ee0d-4ce5-a66b-7678ab80b2db service nova] [instance: 440fb9b0-8413-4576-b61f-5f66b1122e9a] Received unexpected event network-vif-plugged-e39d5f56-a830-45c7-bfae-f8501e19ac16 for instance with vm_state deleted and task_state None.
Oct 26 06:49:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "b7eba875-99ff-4eff-b2fc-d053c999cac5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:56 user nova-compute[74295]: INFO nova.compute.manager [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Terminating instance
Oct 26 06:49:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-38747b7c-52ac-488a-bae4-1302114d69f4 req-e84281ab-418d-46bf-bf0e-19c5ef37f698 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received event network-vif-unplugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-38747b7c-52ac-488a-bae4-1302114d69f4 req-e84281ab-418d-46bf-bf0e-19c5ef37f698 service nova] Acquiring lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-38747b7c-52ac-488a-bae4-1302114d69f4 req-e84281ab-418d-46bf-bf0e-19c5ef37f698 service nova] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-38747b7c-52ac-488a-bae4-1302114d69f4 req-e84281ab-418d-46bf-bf0e-19c5ef37f698 service nova] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-38747b7c-52ac-488a-bae4-1302114d69f4 req-e84281ab-418d-46bf-bf0e-19c5ef37f698 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] No waiting events found dispatching network-vif-unplugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-38747b7c-52ac-488a-bae4-1302114d69f4 req-e84281ab-418d-46bf-bf0e-19c5ef37f698 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received event network-vif-unplugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Instance destroyed successfully.
Oct 26 06:49:56 user nova-compute[74295]: DEBUG nova.objects.instance [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'resources' on Instance uuid b7eba875-99ff-4eff-b2fc-d053c999cac5 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-746117815',display_name='tempest-TestVolumeBootPattern-volume-backed-server-746117815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-746117815',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/GKAc3nWkUbdJ7gZD+lBisak8y61oOZBYy9P2Ye+17oTP2GE3q8LK74wPUPkqtH6b2IDNr7wL8KCgrSkveSErux0mA2tiDVaMXdgA6wQW/oXlEdyNnuTym2j7U9p2Fkw==',key_name='tempest-keypair-896816824',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:45:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-d80iwpc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=b7eba875-99ff-4eff-b2fc-d053c999cac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "address": "fa:16:3e:06:b2:11", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ceb38a0-cf", "ovs_interfaceid": "3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:b2:11,bridge_name='br-int',has_traffic_filtering=True,id=3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ceb38a0-cf') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG os_vif [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b2:11,bridge_name='br-int',has_traffic_filtering=True,id=3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ceb38a0-cf') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ceb38a0-cf, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f528bf5-1a3e-427c-a6af-4752b24b65ea) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:56 user nova-compute[74295]: INFO os_vif [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:b2:11,bridge_name='br-int',has_traffic_filtering=True,id=3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ceb38a0-cf')
Oct 26 06:49:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYIWTpdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:49:56 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:49:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:49:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3294c5-36f8-4ceb-892a-b5c96a37a32e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:49:57 user nova-compute[74295]: No targets found.
Oct 26 06:49:57 user nova-compute[74295]: iSNS:
Oct 26 06:49:57 user nova-compute[74295]: No targets found.
Oct 26 06:49:57 user nova-compute[74295]: STATIC:
Oct 26 06:49:57 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0
Oct 26 06:49:57 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:49:57 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:49:57 user nova-compute[74295]: FIRMWARE:
Oct 26 06:49:57 user nova-compute[74295]: No targets found.
Oct 26 06:49:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:49:57 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:49:57 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5663af90-743d-4032-ae7f-272cd5ebd3e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b107d-916b-4a0e-bcfa-6c988b5d0ba4]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:49:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 (non-flash)
Oct 26 06:49:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac6580d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c71709e-e6d6-4a46-bad4-f72d7c4feed8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0b43d4-87cc-44e5-a5f1-b0a99e39b08e]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd775c2-c40e-4554-8371-a2b9b3496aa7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dae009-2fe8-4f25-a4e6-023b4bc8502f]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[687cb100-82d7-45b3-ac26-c749358ae313]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9df2393-958a-4752-aefb-6cbad49d9626]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0, portal: 172.16.0.220,3260]
Oct 26 06:49:57 user nova-compute[74295]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0, portal: 172.16.0.220,3260] successful.
Oct 26 06:49:57 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b0842-8c80-4ea4-b974-a458fd916e48]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== disconnect_volume: return (330ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:49:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Deleting instance files /opt/stack/data/nova/instances/b7eba875-99ff-4eff-b2fc-d053c999cac5_del
Oct 26 06:49:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Deletion of /opt/stack/data/nova/instances/b7eba875-99ff-4eff-b2fc-d053c999cac5_del complete
Oct 26 06:49:57 user nova-compute[74295]: INFO nova.compute.manager [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 26 06:49:57 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:49:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-d1c07814-d028-4358-9327-37b136f15e11 req-aa20d879-d043-4432-b673-7d07720ecb03 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received event network-vif-plugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d1c07814-d028-4358-9327-37b136f15e11 req-aa20d879-d043-4432-b673-7d07720ecb03 service nova] Acquiring lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d1c07814-d028-4358-9327-37b136f15e11 req-aa20d879-d043-4432-b673-7d07720ecb03 service nova] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:49:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d1c07814-d028-4358-9327-37b136f15e11 req-aa20d879-d043-4432-b673-7d07720ecb03 service nova] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:49:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-d1c07814-d028-4358-9327-37b136f15e11 req-aa20d879-d043-4432-b673-7d07720ecb03 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] No waiting events found dispatching network-vif-plugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:49:58 user nova-compute[74295]: WARNING nova.compute.manager [req-d1c07814-d028-4358-9327-37b136f15e11 req-aa20d879-d043-4432-b673-7d07720ecb03 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received unexpected event network-vif-plugged-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe for instance with vm_state active and task_state deleting.
Oct 26 06:49:58 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:49:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-44b5006f-9900-407d-a3a6-2cc2ac7546b1 req-a09d1a93-b61b-4625-89fd-31346123a521 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Received event network-vif-deleted-3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:49:58 user nova-compute[74295]: INFO nova.compute.manager [req-44b5006f-9900-407d-a3a6-2cc2ac7546b1 req-a09d1a93-b61b-4625-89fd-31346123a521 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Neutron deleted interface 3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe; detaching it from the instance and deleting it from the info cache
Oct 26 06:49:58 user nova-compute[74295]: DEBUG nova.network.neutron [req-44b5006f-9900-407d-a3a6-2cc2ac7546b1 req-a09d1a93-b61b-4625-89fd-31346123a521 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:49:58 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Took 1.23 seconds to deallocate network for instance.
Oct 26 06:49:58 user nova-compute[74295]: DEBUG nova.compute.manager [req-44b5006f-9900-407d-a3a6-2cc2ac7546b1 req-a09d1a93-b61b-4625-89fd-31346123a521 service nova] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Detach interface failed, port_id=3ceb38a0-cfc7-4658-b0f4-bd5767b1c9fe, reason: Instance b7eba875-99ff-4eff-b2fc-d053c999cac5 could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:49:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:49:59 user nova-compute[74295]: INFO nova.compute.manager [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Took 1.15 seconds to detach 1 volumes for instance.
Oct 26 06:49:59 user nova-compute[74295]: DEBUG nova.compute.manager [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: b7eba875-99ff-4eff-b2fc-d053c999cac5] Deleting volume: c1f0bd0b-4d22-4334-b52d-87e6ad4eaea0 {{(pid=74295) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 06:49:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:49:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquired lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'info_cache' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.base [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:50:00 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Deleted allocations for instance b7eba875-99ff-4eff-b2fc-d053c999cac5
Oct 26 06:50:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-aa566645-ea07-40dd-9e52-f28d7940b2b6 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "b7eba875-99ff-4eff-b2fc-d053c999cac5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.146s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updating instance_info_cache with network_info: [{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Releasing lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:50:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance destroyed successfully.
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'resources' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.base [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1591415229',display_name='tempest-AttachVolumeTestJSON-server-1591415229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1591415229',id=33,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7JNBP8TyOuHsG10l/IfSBEWSkkEP86O+W7m1eIwVlzmm7l/gSpZcL5vTicjil3gUPq4t2iOoKKXCyzOLUfkbOoS1QhygvZVkpBJuD4Uq8O5dAEL94jKzDS+1L+rw6ypA==',key_name='tempest-keypair-1584679424',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-io9ajpiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=d05fad65-dd3a-4a04-8b42-f81313c4aca4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG os_vif [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4dc83bc-fc, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c61355d1-856a-4705-afaf-a5e14198434a) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:50:00 user nova-compute[74295]: INFO os_vif [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc')
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Start _get_guest_xml network_info=[{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'numa_topology' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.base [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:50:00 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:50:00 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'vcpu_model' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.base [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1591415229',display_name='tempest-AttachVolumeTestJSON-server-1591415229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1591415229',id=33,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7JNBP8TyOuHsG10l/IfSBEWSkkEP86O+W7m1eIwVlzmm7l/gSpZcL5vTicjil3gUPq4t2iOoKKXCyzOLUfkbOoS1QhygvZVkpBJuD4Uq8O5dAEL94jKzDS+1L+rw6ypA==',key_name='tempest-keypair-1584679424',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-io9ajpiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=d05fad65-dd3a-4a04-8b42-f81313c4aca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'pci_devices' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.objects.base [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:50:00 user nova-compute[74295]:   <uuid>d05fad65-dd3a-4a04-8b42-f81313c4aca4</uuid>
Oct 26 06:50:00 user nova-compute[74295]:   <name>instance-00000021</name>
Oct 26 06:50:00 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:50:00 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:50:00 user nova-compute[74295]:   <metadata>
Oct 26 06:50:00 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:50:00 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:50:00 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeTestJSON-server-1591415229</nova:name>
Oct 26 06:50:00 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:50:00</nova:creationTime>
Oct 26 06:50:00 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:50:00 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:50:00 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:50:00 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:50:00 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:50:00 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:50:00 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:50:00 user nova-compute[74295]:       <nova:owner>
Oct 26 06:50:00 user nova-compute[74295]:         <nova:user uuid="7c0aa0cb8a174036bb890dca38df6e7d">tempest-AttachVolumeTestJSON-93311543-project-member</nova:user>
Oct 26 06:50:00 user nova-compute[74295]:         <nova:project uuid="b5f36efc5cdc4cf5a61b0807a1235ba4">tempest-AttachVolumeTestJSON-93311543</nova:project>
Oct 26 06:50:00 user nova-compute[74295]:       </nova:owner>
Oct 26 06:50:00 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:50:00 user nova-compute[74295]:       <nova:ports>
Oct 26 06:50:00 user nova-compute[74295]:         <nova:port uuid="f4dc83bc-fc9b-437c-a72c-e3f765165204">
Oct 26 06:50:00 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 06:50:00 user nova-compute[74295]:         </nova:port>
Oct 26 06:50:00 user nova-compute[74295]:       </nova:ports>
Oct 26 06:50:00 user nova-compute[74295]:     </nova:instance>
Oct 26 06:50:00 user nova-compute[74295]:   </metadata>
Oct 26 06:50:00 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:50:00 user nova-compute[74295]:     <system>
Oct 26 06:50:00 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:50:00 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:50:00 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:50:00 user nova-compute[74295]:       <entry name="serial">d05fad65-dd3a-4a04-8b42-f81313c4aca4</entry>
Oct 26 06:50:00 user nova-compute[74295]:       <entry name="uuid">d05fad65-dd3a-4a04-8b42-f81313c4aca4</entry>
Oct 26 06:50:00 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:50:00 user nova-compute[74295]:     </system>
Oct 26 06:50:00 user nova-compute[74295]:   </sysinfo>
Oct 26 06:50:00 user nova-compute[74295]:   <os>
Oct 26 06:50:00 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:50:00 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:50:00 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:50:00 user nova-compute[74295]:   </os>
Oct 26 06:50:00 user nova-compute[74295]:   <features>
Oct 26 06:50:00 user nova-compute[74295]:     <acpi/>
Oct 26 06:50:00 user nova-compute[74295]:     <apic/>
Oct 26 06:50:00 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:50:00 user nova-compute[74295]:   </features>
Oct 26 06:50:00 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:50:00 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:50:00 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:50:00 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:50:00 user nova-compute[74295]:   </clock>
Oct 26 06:50:00 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:50:00 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:50:00 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:50:00 user nova-compute[74295]:   </cpu>
Oct 26 06:50:00 user nova-compute[74295]:   <devices>
Oct 26 06:50:00 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:50:00 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:50:00 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk"/>
Oct 26 06:50:00 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:50:00 user nova-compute[74295]:     </disk>
Oct 26 06:50:00 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:50:00 user nova-compute[74295]:       <mac address="fa:16:3e:ba:0d:a5"/>
Oct 26 06:50:00 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:50:00 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:50:00 user nova-compute[74295]:       <target dev="tapf4dc83bc-fc"/>
Oct 26 06:50:00 user nova-compute[74295]:     </interface>
Oct 26 06:50:00 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:50:00 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/console.log" append="off"/>
Oct 26 06:50:00 user nova-compute[74295]:     </serial>
Oct 26 06:50:00 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:50:00 user nova-compute[74295]:     <video>
Oct 26 06:50:00 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:50:00 user nova-compute[74295]:     </video>
Oct 26 06:50:00 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:50:00 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:50:00 user nova-compute[74295]:     </rng>
Oct 26 06:50:00 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:50:00 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:50:00 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:50:00 user nova-compute[74295]:     </memballoon>
Oct 26 06:50:00 user nova-compute[74295]:   </devices>
Oct 26 06:50:00 user nova-compute[74295]: </domain>
Oct 26 06:50:00 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:50:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'trusted_certs' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG nova.objects.base [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Cannot resize image /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'migration_context' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG nova.objects.base [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Object Instance<d05fad65-dd3a-4a04-8b42-f81313c4aca4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1591415229',display_name='tempest-AttachVolumeTestJSON-server-1591415229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1591415229',id=33,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7JNBP8TyOuHsG10l/IfSBEWSkkEP86O+W7m1eIwVlzmm7l/gSpZcL5vTicjil3gUPq4t2iOoKKXCyzOLUfkbOoS1QhygvZVkpBJuD4Uq8O5dAEL94jKzDS+1L+rw6ypA==',key_name='tempest-keypair-1584679424',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-io9ajpiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=d05fad65-dd3a-4a04-8b42-f81313c4aca4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG os_vif [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dbc58bd-f29a-5a04-adee-e1f09d442357', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4dc83bc-fc, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4dc83bc-fc, col_values=(('qos', UUID('70e2e3d3-c198-403c-8289-24299c3b789c')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4dc83bc-fc, col_values=(('external_ids', {'iface-id': 'f4dc83bc-fc9b-437c-a72c-e3f765165204', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:0d:a5', 'vm-uuid': 'd05fad65-dd3a-4a04-8b42-f81313c4aca4'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:50:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:01 user nova-compute[74295]: INFO os_vif [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc')
Oct 26 06:50:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-aacc50fb-8327-41da-8075-c9bcf7d0d6f7 req-01c503f8-301c-43b9-aa99-bc6aa1881bcb service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-aacc50fb-8327-41da-8075-c9bcf7d0d6f7 req-01c503f8-301c-43b9-aa99-bc6aa1881bcb service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-aacc50fb-8327-41da-8075-c9bcf7d0d6f7 req-01c503f8-301c-43b9-aa99-bc6aa1881bcb service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-aacc50fb-8327-41da-8075-c9bcf7d0d6f7 req-01c503f8-301c-43b9-aa99-bc6aa1881bcb service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-aacc50fb-8327-41da-8075-c9bcf7d0d6f7 req-01c503f8-301c-43b9-aa99-bc6aa1881bcb service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:50:03 user nova-compute[74295]: WARNING nova.compute.manager [req-aacc50fb-8327-41da-8075-c9bcf7d0d6f7 req-01c503f8-301c-43b9-aa99-bc6aa1881bcb service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state stopped and task_state powering-on.
Oct 26 06:50:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:50:05 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance rebooted successfully.
Oct 26 06:50:05 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9f4c7754-b6dd-4d19-acaa-a9299118c221 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:50:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-a4d0ddbf-c6e9-46df-9042-26cb78d0da02 req-b6730769-9d08-41b7-a3e7-67f9f2a159b9 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:50:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a4d0ddbf-c6e9-46df-9042-26cb78d0da02 req-b6730769-9d08-41b7-a3e7-67f9f2a159b9 service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a4d0ddbf-c6e9-46df-9042-26cb78d0da02 req-b6730769-9d08-41b7-a3e7-67f9f2a159b9 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a4d0ddbf-c6e9-46df-9042-26cb78d0da02 req-b6730769-9d08-41b7-a3e7-67f9f2a159b9 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-a4d0ddbf-c6e9-46df-9042-26cb78d0da02 req-b6730769-9d08-41b7-a3e7-67f9f2a159b9 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:50:05 user nova-compute[74295]: WARNING nova.compute.manager [req-a4d0ddbf-c6e9-46df-9042-26cb78d0da02 req-b6730769-9d08-41b7-a3e7-67f9f2a159b9 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state active and task_state None.
Oct 26 06:50:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:50:10 user nova-compute[74295]: INFO nova.compute.claims [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Claim successful on node user
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:50:10 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.policy [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75cbe23551274f56b849714907ec72b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe89badcba2e4eb4bcede517fb56abdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:50:10 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Creating image(s)
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "/opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "/opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.189s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk 1073741824" returned: 0 in 0.060s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Successfully created port: c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Cannot resize image /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Ensure instance console log exists: /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Successfully updated port: c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquired lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-f0e6b9f7-054e-41f1-a5dc-3887d958c99c req-4fcae46d-af9d-4e77-b9ad-624a317f765c service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received event network-changed-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.compute.manager [req-f0e6b9f7-054e-41f1-a5dc-3887d958c99c req-4fcae46d-af9d-4e77-b9ad-624a317f765c service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Refreshing instance network info cache due to event network-changed-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f0e6b9f7-054e-41f1-a5dc-3887d958c99c req-4fcae46d-af9d-4e77-b9ad-624a317f765c service nova] Acquiring lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:50:11 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.network.neutron [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating instance_info_cache with network_info: [{"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Releasing lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Instance network_info: |[{"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f0e6b9f7-054e-41f1-a5dc-3887d958c99c req-4fcae46d-af9d-4e77-b9ad-624a317f765c service nova] Acquired lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.network.neutron [req-f0e6b9f7-054e-41f1-a5dc-3887d958c99c req-4fcae46d-af9d-4e77-b9ad-624a317f765c service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Refreshing network info cache for port c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Start _get_guest_xml network_info=[{"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:50:12 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:50:12 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-19705181',display_name='tempest-SnapshotDataIntegrityTests-server-19705181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-19705181',id=41,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHefIF/6K5tCOMUX6OK6m87YtT5ClWFdWDsYhXu0QEt5bf2YfmS8t1gAotpnmApvWTEFuovnRhchpXAuGEgHjcocnxaQa7Gzisi5bA5SD+qeWa5oQCzIBRRFVRAsmjUzyQ==',key_name='tempest-keypair-681420892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe89badcba2e4eb4bcede517fb56abdc',ramdisk_id='',reservation_id='r-hpdclowz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-422939938',owner_user_name='tempest-SnapshotDataIntegrityTests-422939938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75cbe23551274f56b849714907ec72b3',uuid=a1a69164-d3a5-4531-a067-161923f10060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Converting VIF {"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:97,bridge_name='br-int',has_traffic_filtering=True,id=c1ace45a-5d04-4dd3-a5f9-f5c3256e951f,network=Network(71d309af-3e5d-4efb-8292-f8a7d884c69f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace45a-5d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.objects.instance [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'pci_devices' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:50:12 user nova-compute[74295]:   <uuid>a1a69164-d3a5-4531-a067-161923f10060</uuid>
Oct 26 06:50:12 user nova-compute[74295]:   <name>instance-00000029</name>
Oct 26 06:50:12 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:50:12 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:50:12 user nova-compute[74295]:   <metadata>
Oct 26 06:50:12 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:50:12 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:50:12 user nova-compute[74295]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-19705181</nova:name>
Oct 26 06:50:12 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:50:12</nova:creationTime>
Oct 26 06:50:12 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:50:12 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:50:12 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:50:12 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:50:12 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:50:12 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:50:12 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:50:12 user nova-compute[74295]:       <nova:owner>
Oct 26 06:50:12 user nova-compute[74295]:         <nova:user uuid="75cbe23551274f56b849714907ec72b3">tempest-SnapshotDataIntegrityTests-422939938-project-member</nova:user>
Oct 26 06:50:12 user nova-compute[74295]:         <nova:project uuid="fe89badcba2e4eb4bcede517fb56abdc">tempest-SnapshotDataIntegrityTests-422939938</nova:project>
Oct 26 06:50:12 user nova-compute[74295]:       </nova:owner>
Oct 26 06:50:12 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:50:12 user nova-compute[74295]:       <nova:ports>
Oct 26 06:50:12 user nova-compute[74295]:         <nova:port uuid="c1ace45a-5d04-4dd3-a5f9-f5c3256e951f">
Oct 26 06:50:12 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 06:50:12 user nova-compute[74295]:         </nova:port>
Oct 26 06:50:12 user nova-compute[74295]:       </nova:ports>
Oct 26 06:50:12 user nova-compute[74295]:     </nova:instance>
Oct 26 06:50:12 user nova-compute[74295]:   </metadata>
Oct 26 06:50:12 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:50:12 user nova-compute[74295]:     <system>
Oct 26 06:50:12 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:50:12 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:50:12 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:50:12 user nova-compute[74295]:       <entry name="serial">a1a69164-d3a5-4531-a067-161923f10060</entry>
Oct 26 06:50:12 user nova-compute[74295]:       <entry name="uuid">a1a69164-d3a5-4531-a067-161923f10060</entry>
Oct 26 06:50:12 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:50:12 user nova-compute[74295]:     </system>
Oct 26 06:50:12 user nova-compute[74295]:   </sysinfo>
Oct 26 06:50:12 user nova-compute[74295]:   <os>
Oct 26 06:50:12 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:50:12 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:50:12 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:50:12 user nova-compute[74295]:   </os>
Oct 26 06:50:12 user nova-compute[74295]:   <features>
Oct 26 06:50:12 user nova-compute[74295]:     <acpi/>
Oct 26 06:50:12 user nova-compute[74295]:     <apic/>
Oct 26 06:50:12 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:50:12 user nova-compute[74295]:   </features>
Oct 26 06:50:12 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:50:12 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:50:12 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:50:12 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:50:12 user nova-compute[74295]:   </clock>
Oct 26 06:50:12 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:50:12 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:50:12 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:50:12 user nova-compute[74295]:   </cpu>
Oct 26 06:50:12 user nova-compute[74295]:   <devices>
Oct 26 06:50:12 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:50:12 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:50:12 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk"/>
Oct 26 06:50:12 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:50:12 user nova-compute[74295]:     </disk>
Oct 26 06:50:12 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:50:12 user nova-compute[74295]:       <mac address="fa:16:3e:dd:27:97"/>
Oct 26 06:50:12 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:50:12 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:50:12 user nova-compute[74295]:       <target dev="tapc1ace45a-5d"/>
Oct 26 06:50:12 user nova-compute[74295]:     </interface>
Oct 26 06:50:12 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:50:12 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/console.log" append="off"/>
Oct 26 06:50:12 user nova-compute[74295]:     </serial>
Oct 26 06:50:12 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:50:12 user nova-compute[74295]:     <video>
Oct 26 06:50:12 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:50:12 user nova-compute[74295]:     </video>
Oct 26 06:50:12 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:50:12 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:50:12 user nova-compute[74295]:     </rng>
Oct 26 06:50:12 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:50:12 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:50:12 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:50:12 user nova-compute[74295]:     </memballoon>
Oct 26 06:50:12 user nova-compute[74295]:   </devices>
Oct 26 06:50:12 user nova-compute[74295]: </domain>
Oct 26 06:50:12 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-19705181',display_name='tempest-SnapshotDataIntegrityTests-server-19705181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-19705181',id=41,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHefIF/6K5tCOMUX6OK6m87YtT5ClWFdWDsYhXu0QEt5bf2YfmS8t1gAotpnmApvWTEFuovnRhchpXAuGEgHjcocnxaQa7Gzisi5bA5SD+qeWa5oQCzIBRRFVRAsmjUzyQ==',key_name='tempest-keypair-681420892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe89badcba2e4eb4bcede517fb56abdc',ramdisk_id='',reservation_id='r-hpdclowz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-422939938',owner_user_name='tempest-SnapshotDataIntegrityTests-422939938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75cbe23551274f56b849714907ec72b3',uuid=a1a69164-d3a5-4531-a067-161923f10060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Converting VIF {"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:97,bridge_name='br-int',has_traffic_filtering=True,id=c1ace45a-5d04-4dd3-a5f9-f5c3256e951f,network=Network(71d309af-3e5d-4efb-8292-f8a7d884c69f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace45a-5d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG os_vif [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:97,bridge_name='br-int',has_traffic_filtering=True,id=c1ace45a-5d04-4dd3-a5f9-f5c3256e951f,network=Network(71d309af-3e5d-4efb-8292-f8a7d884c69f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace45a-5d') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0501efb6-bbe9-57be-a0fe-b9a9f1b536f1', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1ace45a-5d, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1ace45a-5d, col_values=(('qos', UUID('a12a9ebd-6d70-46bc-890a-a2582f14d40c')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1ace45a-5d, col_values=(('external_ids', {'iface-id': 'c1ace45a-5d04-4dd3-a5f9-f5c3256e951f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:27:97', 'vm-uuid': 'a1a69164-d3a5-4531-a067-161923f10060'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:12 user nova-compute[74295]: INFO os_vif [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:97,bridge_name='br-int',has_traffic_filtering=True,id=c1ace45a-5d04-4dd3-a5f9-f5c3256e951f,network=Network(71d309af-3e5d-4efb-8292-f8a7d884c69f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace45a-5d')
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No VIF found with MAC fa:16:3e:dd:27:97, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.network.neutron [req-f0e6b9f7-054e-41f1-a5dc-3887d958c99c req-4fcae46d-af9d-4e77-b9ad-624a317f765c service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updated VIF entry in instance network info cache for port c1ace45a-5d04-4dd3-a5f9-f5c3256e951f. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG nova.network.neutron [req-f0e6b9f7-054e-41f1-a5dc-3887d958c99c req-4fcae46d-af9d-4e77-b9ad-624a317f765c service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating instance_info_cache with network_info: [{"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f0e6b9f7-054e-41f1-a5dc-3887d958c99c req-4fcae46d-af9d-4e77-b9ad-624a317f765c service nova] Releasing lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:50:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-7e39864c-a802-431b-be3f-68475c0e7dba req-f1fc57d8-8b3d-4cbf-86fc-37d265f5e5d3 service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received event network-vif-plugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:50:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7e39864c-a802-431b-be3f-68475c0e7dba req-f1fc57d8-8b3d-4cbf-86fc-37d265f5e5d3 service nova] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7e39864c-a802-431b-be3f-68475c0e7dba req-f1fc57d8-8b3d-4cbf-86fc-37d265f5e5d3 service nova] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7e39864c-a802-431b-be3f-68475c0e7dba req-f1fc57d8-8b3d-4cbf-86fc-37d265f5e5d3 service nova] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-7e39864c-a802-431b-be3f-68475c0e7dba req-f1fc57d8-8b3d-4cbf-86fc-37d265f5e5d3 service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] No waiting events found dispatching network-vif-plugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:50:14 user nova-compute[74295]: WARNING nova.compute.manager [req-7e39864c-a802-431b-be3f-68475c0e7dba req-f1fc57d8-8b3d-4cbf-86fc-37d265f5e5d3 service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received unexpected event network-vif-plugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f for instance with vm_state building and task_state spawning.
Oct 26 06:50:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:50:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:50:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: a1a69164-d3a5-4531-a067-161923f10060] Instance spawned successfully.
Oct 26 06:50:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:50:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:50:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:50:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:50:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:50:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:50:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:50:16 user nova-compute[74295]: INFO nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Took 5.36 seconds to spawn the instance on the hypervisor.
Oct 26 06:50:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:50:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d637927-370e-4c56-9603-1034255fbdbe req-d2986266-e7a1-4f04-bc05-4b0b593e9d2f service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received event network-vif-plugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:50:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d637927-370e-4c56-9603-1034255fbdbe req-d2986266-e7a1-4f04-bc05-4b0b593e9d2f service nova] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d637927-370e-4c56-9603-1034255fbdbe req-d2986266-e7a1-4f04-bc05-4b0b593e9d2f service nova] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2d637927-370e-4c56-9603-1034255fbdbe req-d2986266-e7a1-4f04-bc05-4b0b593e9d2f service nova] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-2d637927-370e-4c56-9603-1034255fbdbe req-d2986266-e7a1-4f04-bc05-4b0b593e9d2f service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] No waiting events found dispatching network-vif-plugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:50:16 user nova-compute[74295]: WARNING nova.compute.manager [req-2d637927-370e-4c56-9603-1034255fbdbe req-d2986266-e7a1-4f04-bc05-4b0b593e9d2f service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received unexpected event network-vif-plugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f for instance with vm_state building and task_state spawning.
Oct 26 06:50:16 user nova-compute[74295]: INFO nova.compute.manager [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Took 5.98 seconds to build instance.
Oct 26 06:50:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-e0fe490b-0ff2-4167-8d8b-7d8c4d0e3298 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.104s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:18 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:21 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:50:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:50:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:50:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8423MB free_disk=25.218624114990234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:50:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:50:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:28 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:28 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:50:28 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 26 06:50:28 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:50:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:28 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:37 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:50:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:47 user nova-compute[74295]: INFO nova.compute.manager [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Unshelving
Oct 26 06:50:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:47 user nova-compute[74295]: INFO nova.virt.block_device [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Booting with volume 24f5da3d-6be1-48f0-8a24-40fe5bacd713 at /dev/vdc
Oct 26 06:50:47 user nova-compute[74295]: DEBUG os_brick.utils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf8f1ce-401d-4000-9622-387c48ceea93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f09069-eeb7-459b-a207-c4d6feb90aee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2365fc77-c356-4d69-b4dc-778fd23e7558]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5fc9d3-d4ec-4f41-a54e-7b77390ab327]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:50:47 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:50:47 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[998b50f8-25d1-496b-862a-dd878133706d]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG os_brick.utils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating existing volume attachment record: 3628438a-5715-4423-948e-94c20f567b55 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:50:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-d9a6ce66-4566-4915-9358-2dde043577ed req-3e6aa46d-f129-45af-91b4-d5de827cd89c service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received event network-changed-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-d9a6ce66-4566-4915-9358-2dde043577ed req-3e6aa46d-f129-45af-91b4-d5de827cd89c service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Refreshing instance network info cache due to event network-changed-43c1cebd-71b0-4cf9-bc83-a5c15667c63b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d9a6ce66-4566-4915-9358-2dde043577ed req-3e6aa46d-f129-45af-91b4-d5de827cd89c service nova] Acquiring lock "refresh_cache-ac34132a-3908-4cc8-b65f-bc2ed005ccf6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d9a6ce66-4566-4915-9358-2dde043577ed req-3e6aa46d-f129-45af-91b4-d5de827cd89c service nova] Acquired lock "refresh_cache-ac34132a-3908-4cc8-b65f-bc2ed005ccf6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG nova.network.neutron [req-d9a6ce66-4566-4915-9358-2dde043577ed req-3e6aa46d-f129-45af-91b4-d5de827cd89c service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Refreshing network info cache for port 43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'flavor' on Instance uuid ac34132a-3908-4cc8-b65f-bc2ed005ccf6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:50:51 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Ignoring supplied device name: /dev/vdb
Oct 26 06:50:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:50:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:50:51 user nova-compute[74295]: INFO nova.compute.manager [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Attaching volume c8b7a677-3669-4522-a1e5-747e09d94dd1 to /dev/vdb
Oct 26 06:50:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-d9a6ce66-4566-4915-9358-2dde043577ed req-3e6aa46d-f129-45af-91b4-d5de827cd89c service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Updated VIF entry in instance network info cache for port 43c1cebd-71b0-4cf9-bc83-a5c15667c63b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-d9a6ce66-4566-4915-9358-2dde043577ed req-3e6aa46d-f129-45af-91b4-d5de827cd89c service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Updating instance_info_cache with network_info: [{"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG os_brick.utils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d9a6ce66-4566-4915-9358-2dde043577ed req-3e6aa46d-f129-45af-91b4-d5de827cd89c service nova] Releasing lock "refresh_cache-ac34132a-3908-4cc8-b65f-bc2ed005ccf6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f147bdea-3370-4666-9451-33fa99bd6f25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3420c7-6472-4a59-9655-c56a82f9f4a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e45482c-fedc-4925-8bb9-f47f803e08e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65874ec-4f68-4790-bd1a-1e40c888b98e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:50:52 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:50:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8f506e-1d6c-41fc-88d9-c985cc4b4ddc]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG os_brick.utils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Updating existing volume attachment record: 3bf90fa1-8489-4fe9-b57c-4c7cd6e47eef {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:50:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'pci_requests' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'numa_topology' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:51:07 user nova-compute[74295]: INFO nova.compute.claims [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Claim successful on node user
Oct 26 06:51:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "89037419-923d-4694-bf39-30f63ae4de16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "89037419-923d-4694-bf39-30f63ae4de16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.052s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:51:07 user nova-compute[74295]: INFO nova.compute.claims [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Claim successful on node user
Oct 26 06:51:07 user nova-compute[74295]: INFO nova.network.neutron [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating port 76720f8b-41b5-44f4-b4d3-5f501b977acb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:51:07 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:51:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:07 user nova-compute[74295]: INFO nova.virt.block_device [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Booting with volume c9fcdae4-3465-4086-9bf4-013fc1f2c5be at /dev/vda
Oct 26 06:51:07 user nova-compute[74295]: DEBUG nova.policy [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f8c68bbe2245c6b6f159c45e006216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe63ca1f244085963c38b864dff1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG os_brick.utils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21833f1-20d1-4edf-a1c2-a12a677fd2f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[719b6247-4c24-4e98-84da-79a64d451639]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c059f2-596b-4635-98ac-b8ea39f6b65b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac53a4f-52af-4064-ac34-f63fa970c3b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:51:08 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f5ae5b-a7d7-4059-9ede-6fba33647f2e]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG os_brick.utils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Updating existing volume attachment record: 90237b56-c00f-4551-a407-f4de65765364 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquired lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.compute.manager [req-05a7d17a-83cc-4f18-ac00-3f1075b1b06b req-218d1770-1131-4da0-b63f-62d499c020fd service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-changed-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.compute.manager [req-05a7d17a-83cc-4f18-ac00-3f1075b1b06b req-218d1770-1131-4da0-b63f-62d499c020fd service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Refreshing instance network info cache due to event network-changed-76720f8b-41b5-44f4-b4d3-5f501b977acb. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-05a7d17a-83cc-4f18-ac00-3f1075b1b06b req-218d1770-1131-4da0-b63f-62d499c020fd service nova] Acquiring lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Successfully created port: cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.network.neutron [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating instance_info_cache with network_info: [{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Releasing lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:51:08 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Creating image(s)
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'trusted_certs' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-05a7d17a-83cc-4f18-ac00-3f1075b1b06b req-218d1770-1131-4da0-b63f-62d499c020fd service nova] Acquired lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.network.neutron [req-05a7d17a-83cc-4f18-ac00-3f1075b1b06b req-218d1770-1131-4da0-b63f-62d499c020fd service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Refreshing network info cache for port 76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG nova.objects.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<cfde0bac-90db-40c0-90c6-957b2baf948c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "7f126925d6c2d825cb907c20c7eef5c9b677d622" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "7f126925d6c2d825cb907c20c7eef5c9b677d622" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:09 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Successfully updated port: cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c44b124-07ac-44d1-b0a1-53e847280814 req-700cac04-9688-4f71-888a-d88d12b8adeb service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received event network-changed-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c44b124-07ac-44d1-b0a1-53e847280814 req-700cac04-9688-4f71-888a-d88d12b8adeb service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Refreshing instance network info cache due to event network-changed-cb61ba87-d0f5-4081-81a5-f55a1efdec30. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c44b124-07ac-44d1-b0a1-53e847280814 req-700cac04-9688-4f71-888a-d88d12b8adeb service nova] Acquiring lock "refresh_cache-89037419-923d-4694-bf39-30f63ae4de16" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c44b124-07ac-44d1-b0a1-53e847280814 req-700cac04-9688-4f71-888a-d88d12b8adeb service nova] Acquired lock "refresh_cache-89037419-923d-4694-bf39-30f63ae4de16" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.network.neutron [req-6c44b124-07ac-44d1-b0a1-53e847280814 req-700cac04-9688-4f71-888a-d88d12b8adeb service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Refreshing network info cache for port cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "refresh_cache-89037419-923d-4694-bf39-30f63ae4de16" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.network.neutron [req-6c44b124-07ac-44d1-b0a1-53e847280814 req-700cac04-9688-4f71-888a-d88d12b8adeb service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622.part --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.virt.images [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] 4fe17822-4e64-43b0-b856-dd5bc3587cd6 was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622.part /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.network.neutron [req-6c44b124-07ac-44d1-b0a1-53e847280814 req-700cac04-9688-4f71-888a-d88d12b8adeb service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.network.neutron [req-05a7d17a-83cc-4f18-ac00-3f1075b1b06b req-218d1770-1131-4da0-b63f-62d499c020fd service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updated VIF entry in instance network info cache for port 76720f8b-41b5-44f4-b4d3-5f501b977acb. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.network.neutron [req-05a7d17a-83cc-4f18-ac00-3f1075b1b06b req-218d1770-1131-4da0-b63f-62d499c020fd service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating instance_info_cache with network_info: [{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c44b124-07ac-44d1-b0a1-53e847280814 req-700cac04-9688-4f71-888a-d88d12b8adeb service nova] Releasing lock "refresh_cache-89037419-923d-4694-bf39-30f63ae4de16" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquired lock "refresh_cache-89037419-923d-4694-bf39-30f63ae4de16" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-05a7d17a-83cc-4f18-ac00-3f1075b1b06b req-218d1770-1131-4da0-b63f-62d499c020fd service nova] Releasing lock "refresh_cache-cfde0bac-90db-40c0-90c6-957b2baf948c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622.part /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622.converted" returned: 0 in 0.538s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.network.neutron [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Updating instance_info_cache with network_info: [{"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Releasing lock "refresh_cache-89037419-923d-4694-bf39-30f63ae4de16" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Instance network_info: |[{"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpvGNQqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:51:10 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:51:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:51:10 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:51:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:51:10 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "7f126925d6c2d825cb907c20c7eef5c9b677d622" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.146s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[449253ca-e768-4cc4-894e-52d3cde81a59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:51:10 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:10 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f581c44-0505-448d-b45b-03d7e7c302c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1] added
Oct 26 06:51:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd561f93-7d78-47cc-a069-8813f31b350b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1055155f-6ffb-4183-89f6-6b1d0dfe1817]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpvGNQqE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpvGNQqE" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47d7e00-f79d-46a8-9e1a-b55af64627ec]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpvGNQqE'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[570b49f9-c533-47c1-9c7b-bfc5f2094a4c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c716a7-58f6-49a6-ba50-ee41a52e7f20]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 06:51:11 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 06:51:11 user nova-compute[74295]:  {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:51:11 user nova-compute[74295]: WARNING os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 06:51:11 user nova-compute[74295]: 
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622 --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "7f126925d6c2d825cb907c20c7eef5c9b677d622" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "7f126925d6c2d825cb907c20c7eef5c9b677d622" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7026a328-3fe2-44d6-9204-498834c23a55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1, portal: 172.16.0.220,3260]
Oct 26 06:51:11 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1, portal: 172.16.0.220,3260] successful.
Oct 26 06:51:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ab3e73-7eb6-453a-af2e-9d276e1d98e4]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd627767-32ff-4634-9f5b-fdc3b35e8aa4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8c6e8c-e149-484c-8b44-f674c9b1499c]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpvGNQqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622 --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622,backing_fmt=raw /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622,backing_fmt=raw /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk 1073741824" returned: 0 in 0.049s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "7f126925d6c2d825cb907c20c7eef5c9b677d622" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622 --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'migration_context' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG nova.objects.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<cfde0bac-90db-40c0-90c6-957b2baf948c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:51:11 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Rebasing disk image.
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 -F raw /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23733386335366536', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733386335366536', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'flavor' on Instance uuid ac34132a-3908-4cc8-b65f-bc2ed005ccf6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:51:12 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:51:12 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:51:12 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:51:12 user nova-compute[74295]:   <serial>c8b7a677-3669-4522-a1e5-747e09d94dd1</serial>
Oct 26 06:51:12 user nova-compute[74295]: </disk>
Oct 26 06:51:12 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No VIF found with MAC fa:16:3e:98:a0:9b, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:51:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c0f273a8-31fa-4158-b557-94c28ba0b6b6 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.938s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 -F raw /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk" returned: 0 in 2.522s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Ensure instance console log exists: /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Start _get_guest_xml network_info=[{"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='03c93ec2d768e223fb86c01436be575d',container_format='bare',created_at=2023-10-26T06:48:55Z,direct_url=<?>,disk_format='qcow2',id=4fe17822-4e64-43b0-b856-dd5bc3587cd6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1987518129-shelved',owner='74a74a5d314a4075923b5c21b2c39097',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T06:48:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '3628438a-5715-4423-948e-94c20f567b55', 'boot_index': None, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdpQwKux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'cfde0bac-90db-40c0-90c6-957b2baf948c', 'attached_at': '', 'detached_at': '', 'volume_id': '24f5da3d-6be1-48f0-8a24-40fe5bacd713', 'serial': '24f5da3d-6be1-48f0-8a24-40fe5bacd713'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:51:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:51:14 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='03c93ec2d768e223fb86c01436be575d',container_format='bare',created_at=2023-10-26T06:48:55Z,direct_url=<?>,disk_format='qcow2',id=4fe17822-4e64-43b0-b856-dd5bc3587cd6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1987518129-shelved',owner='74a74a5d314a4075923b5c21b2c39097',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T06:48:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'vcpu_model' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.objects.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<cfde0bac-90db-40c0-90c6-957b2baf948c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdpQwKux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:51:14 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:51:14 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:51:14 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0cb8d7-1054-4e83-b476-e6559e63de67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:51:14 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c79d56-3e44-4a06-a764-05da340c6a43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713] added
Oct 26 06:51:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cbff4b-3bc5-4ed0-a14a-03f178c57e93]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e515295-2691-42c8-88bf-e0a00d41d909]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdpQwKux {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdpQwKux" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7942ea6-52ca-4dff-a62e-b5ede6a84c32]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UdpQwKux'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[380b301f-8165-46fb-8e44-0c1febdea6a2]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e2b871-4d7b-49cd-a5e0-e55a654a8cf1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ee2ff8-f44d-4958-9eff-1b3c7266a12a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713, portal: 172.16.0.220,3260]
Oct 26 06:51:14 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713, portal: 172.16.0.220,3260] successful.
Oct 26 06:51:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cc8e39-9af8-482a-94ad-f5b9edbaebbc]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd463dce-ceab-4859-aca7-79713cc75b8a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:14 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:51:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:14 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:51:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[34603e20-3252-4f1e-81d8-be1db521ecfd]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdpQwKux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23539623465356662', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539623465356662', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1987518129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1987518129',id=37,image_ref='4fe17822-4e64-43b0-b856-dd5bc3587cd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-52913859',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-432f93yk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member',shelved_at='2023-10-26T06:48:59.191335',shelved_host='user',shelved_image_id='4fe17822-4e64-43b0-b856-dd5bc3587cd6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=cfde0bac-90db-40c0-90c6-957b2baf948c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'pci_devices' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.objects.base [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<cfde0bac-90db-40c0-90c6-957b2baf948c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:51:15 user nova-compute[74295]:   <uuid>cfde0bac-90db-40c0-90c6-957b2baf948c</uuid>
Oct 26 06:51:15 user nova-compute[74295]:   <name>instance-00000025</name>
Oct 26 06:51:15 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:51:15 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:51:15 user nova-compute[74295]:   <metadata>
Oct 26 06:51:15 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:51:15 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:51:15 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1987518129</nova:name>
Oct 26 06:51:15 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:51:14</nova:creationTime>
Oct 26 06:51:15 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:51:15 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:51:15 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:51:15 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:51:15 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:51:15 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:51:15 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:51:15 user nova-compute[74295]:       <nova:owner>
Oct 26 06:51:15 user nova-compute[74295]:         <nova:user uuid="8ce2ec6aad1e4e068958bcc61d50cb73">tempest-AttachVolumeShelveTestJSON-1252316399-project-member</nova:user>
Oct 26 06:51:15 user nova-compute[74295]:         <nova:project uuid="74a74a5d314a4075923b5c21b2c39097">tempest-AttachVolumeShelveTestJSON-1252316399</nova:project>
Oct 26 06:51:15 user nova-compute[74295]:       </nova:owner>
Oct 26 06:51:15 user nova-compute[74295]:       <nova:root type="image" uuid="4fe17822-4e64-43b0-b856-dd5bc3587cd6"/>
Oct 26 06:51:15 user nova-compute[74295]:       <nova:ports>
Oct 26 06:51:15 user nova-compute[74295]:         <nova:port uuid="76720f8b-41b5-44f4-b4d3-5f501b977acb">
Oct 26 06:51:15 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 06:51:15 user nova-compute[74295]:         </nova:port>
Oct 26 06:51:15 user nova-compute[74295]:       </nova:ports>
Oct 26 06:51:15 user nova-compute[74295]:     </nova:instance>
Oct 26 06:51:15 user nova-compute[74295]:   </metadata>
Oct 26 06:51:15 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:51:15 user nova-compute[74295]:     <system>
Oct 26 06:51:15 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:51:15 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:51:15 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:51:15 user nova-compute[74295]:       <entry name="serial">cfde0bac-90db-40c0-90c6-957b2baf948c</entry>
Oct 26 06:51:15 user nova-compute[74295]:       <entry name="uuid">cfde0bac-90db-40c0-90c6-957b2baf948c</entry>
Oct 26 06:51:15 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:51:15 user nova-compute[74295]:     </system>
Oct 26 06:51:15 user nova-compute[74295]:   </sysinfo>
Oct 26 06:51:15 user nova-compute[74295]:   <os>
Oct 26 06:51:15 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:51:15 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:51:15 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:51:15 user nova-compute[74295]:   </os>
Oct 26 06:51:15 user nova-compute[74295]:   <features>
Oct 26 06:51:15 user nova-compute[74295]:     <acpi/>
Oct 26 06:51:15 user nova-compute[74295]:     <apic/>
Oct 26 06:51:15 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:51:15 user nova-compute[74295]:   </features>
Oct 26 06:51:15 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:51:15 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:51:15 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:51:15 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:51:15 user nova-compute[74295]:   </clock>
Oct 26 06:51:15 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:51:15 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:51:15 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:51:15 user nova-compute[74295]:   </cpu>
Oct 26 06:51:15 user nova-compute[74295]:   <devices>
Oct 26 06:51:15 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:51:15 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:51:15 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk"/>
Oct 26 06:51:15 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:51:15 user nova-compute[74295]:     </disk>
Oct 26 06:51:15 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:51:15 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:51:15 user nova-compute[74295]:       <source dev="/dev/sdc"/>
Oct 26 06:51:15 user nova-compute[74295]:       <target dev="vdc" bus="virtio"/>
Oct 26 06:51:15 user nova-compute[74295]:       <serial>24f5da3d-6be1-48f0-8a24-40fe5bacd713</serial>
Oct 26 06:51:15 user nova-compute[74295]:     </disk>
Oct 26 06:51:15 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:51:15 user nova-compute[74295]:       <mac address="fa:16:3e:cc:64:e5"/>
Oct 26 06:51:15 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:51:15 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:51:15 user nova-compute[74295]:       <target dev="tap76720f8b-41"/>
Oct 26 06:51:15 user nova-compute[74295]:     </interface>
Oct 26 06:51:15 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:51:15 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/console.log" append="off"/>
Oct 26 06:51:15 user nova-compute[74295]:     </serial>
Oct 26 06:51:15 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:51:15 user nova-compute[74295]:     <video>
Oct 26 06:51:15 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:51:15 user nova-compute[74295]:     </video>
Oct 26 06:51:15 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:51:15 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:51:15 user nova-compute[74295]:     </rng>
Oct 26 06:51:15 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:51:15 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:51:15 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:51:15 user nova-compute[74295]:     </memballoon>
Oct 26 06:51:15 user nova-compute[74295]:   </devices>
Oct 26 06:51:15 user nova-compute[74295]: </domain>
Oct 26 06:51:15 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1987518129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1987518129',id=37,image_ref='4fe17822-4e64-43b0-b856-dd5bc3587cd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-52913859',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-432f93yk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member',shelved_at='2023-10-26T06:48:59.191335',shelved_host='user',shelved_image_id='4fe17822-4e64-43b0-b856-dd5bc3587cd6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=cfde0bac-90db-40c0-90c6-957b2baf948c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG os_vif [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac0a0b9e-b52c-5cca-8ba8-2e0b9b92951a', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76720f8b-41, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76720f8b-41, col_values=(('qos', UUID('49ff6fda-ded5-4297-b1e7-a6f463d37af9')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76720f8b-41, col_values=(('external_ids', {'iface-id': '76720f8b-41b5-44f4-b4d3-5f501b977acb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:64:e5', 'vm-uuid': 'cfde0bac-90db-40c0-90c6-957b2baf948c'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:15 user nova-compute[74295]: INFO os_vif [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41')
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:51:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] No VIF found with MAC fa:16:3e:cc:64:e5, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-b9d570c9-4cb2-42f2-801b-a0fc0c0bd4f7 req-b9b07a47-fc65-43ed-bc08-9d97693e1e60 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b9d570c9-4cb2-42f2-801b-a0fc0c0bd4f7 req-b9b07a47-fc65-43ed-bc08-9d97693e1e60 service nova] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b9d570c9-4cb2-42f2-801b-a0fc0c0bd4f7 req-b9b07a47-fc65-43ed-bc08-9d97693e1e60 service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b9d570c9-4cb2-42f2-801b-a0fc0c0bd4f7 req-b9b07a47-fc65-43ed-bc08-9d97693e1e60 service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-b9d570c9-4cb2-42f2-801b-a0fc0c0bd4f7 req-b9b07a47-fc65-43ed-bc08-9d97693e1e60 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] No waiting events found dispatching network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:51:17 user nova-compute[74295]: WARNING nova.compute.manager [req-b9d570c9-4cb2-42f2-801b-a0fc0c0bd4f7 req-b9b07a47-fc65-43ed-bc08-9d97693e1e60 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received unexpected event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 06:51:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:51:19 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:51:19 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance spawned successfully.
Oct 26 06:51:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-96b44307-9bec-4c83-8acc-e347efddfe00 req-2dd51d0a-a5a4-4201-965d-9011bc29189d service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:51:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-96b44307-9bec-4c83-8acc-e347efddfe00 req-2dd51d0a-a5a4-4201-965d-9011bc29189d service nova] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-96b44307-9bec-4c83-8acc-e347efddfe00 req-2dd51d0a-a5a4-4201-965d-9011bc29189d service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-96b44307-9bec-4c83-8acc-e347efddfe00 req-2dd51d0a-a5a4-4201-965d-9011bc29189d service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-96b44307-9bec-4c83-8acc-e347efddfe00 req-2dd51d0a-a5a4-4201-965d-9011bc29189d service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] No waiting events found dispatching network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:51:19 user nova-compute[74295]: WARNING nova.compute.manager [req-96b44307-9bec-4c83-8acc-e347efddfe00 req-2dd51d0a-a5a4-4201-965d-9011bc29189d service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received unexpected event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 06:51:19 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:51:19 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:51:19 user nova-compute[74295]: DEBUG nova.compute.manager [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:51:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5f23ab18-74ad-4b81-a00b-e7eeb7c43f1b tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 32.547s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:51:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:21 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:51:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:51:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:51:23 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:51:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8443MB free_disk=25.138317108154297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:51:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance d05fad65-dd3a-4a04-8b42-f81313c4aca4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cfde0bac-90db-40c0-90c6-957b2baf948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 89037419-923d-4694-bf39-30f63ae4de16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:51:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:51:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:51:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:51:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:51:28 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Creating image(s)
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Ensure instance console log exists: /opt/stack/data/nova/instances/89037419-923d-4694-bf39-30f63ae4de16/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Start _get_guest_xml network_info=[{"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '90237b56-c00f-4551-a407-f4de65765364', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSYcHXpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89037419-923d-4694-bf39-30f63ae4de16', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'serial': 'c9fcdae4-3465-4086-9bf4-013fc1f2c5be'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:51:28 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:51:28 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSYcHXpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:51:28 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:51:28 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:51:28 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6531bd27-c4e7-422a-9e67-dbb34a53847f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:51:28 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[64056785-6f4f-4243-b95c-e912aed4b85a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be] added
Oct 26 06:51:28 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14f361f-7ee7-429e-8a38-876079c9bd66]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bd811f-48ee-4879-bedb-9b7d49a804e8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSYcHXpa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSYcHXpa" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6409e87-5b3a-41c2-baf0-2a409f17b764]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WSYcHXpa'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36c1b72-14f2-44eb-bc8b-07166090d3bc]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5680760-b4ff-4bc7-8331-653eaa185535]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:28 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:51:28 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:28 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:51:28 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e444ed-96aa-4e54-8856-4f245f5c802d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260]
Oct 26 06:51:28 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260] successful.
Oct 26 06:51:28 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ed840f-ddd9-4a25-bdcb-65d541517e85]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2932174-65a9-4c61-8b0e-c6490625a562]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:28 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:51:28 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:51:28 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:51:28 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:51:28 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:51:28 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c9d1cd-f77f-4cc4-be57-9f57b4985592]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:51:28 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSYcHXpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23766363162356565', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766363162356565', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1802759031',display_name='tempest-TestVolumeBootPattern-server-1802759031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1802759031',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO37LOfLGVLm8denc0aiOr8WCYx77Qraf7D47fN50S5LIaTBdJywjgiKJrg/08AIIVYLPW9NSG8sjHJOCwCiCGyrZMujB/2p5ls6F3JGSk5q17MYb1TgqAWMzwRKoYJlRg==',key_name='tempest-TestVolumeBootPattern-373663211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-o73xdxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:51:08Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=89037419-923d-4694-bf39-30f63ae4de16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=cb61ba87-d0f5-4081-81a5-f55a1efdec30,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb61ba87-d0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.objects.instance [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'pci_devices' on Instance uuid 89037419-923d-4694-bf39-30f63ae4de16 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:51:29 user nova-compute[74295]:   <uuid>89037419-923d-4694-bf39-30f63ae4de16</uuid>
Oct 26 06:51:29 user nova-compute[74295]:   <name>instance-0000002a</name>
Oct 26 06:51:29 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:51:29 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:51:29 user nova-compute[74295]:   <metadata>
Oct 26 06:51:29 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:51:29 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:51:29 user nova-compute[74295]:       <nova:name>tempest-TestVolumeBootPattern-server-1802759031</nova:name>
Oct 26 06:51:29 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:51:28</nova:creationTime>
Oct 26 06:51:29 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:51:29 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:51:29 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:51:29 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:51:29 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:51:29 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:51:29 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:51:29 user nova-compute[74295]:       <nova:owner>
Oct 26 06:51:29 user nova-compute[74295]:         <nova:user uuid="11f8c68bbe2245c6b6f159c45e006216">tempest-TestVolumeBootPattern-594294549-project-member</nova:user>
Oct 26 06:51:29 user nova-compute[74295]:         <nova:project uuid="75fe63ca1f244085963c38b864dff1db">tempest-TestVolumeBootPattern-594294549</nova:project>
Oct 26 06:51:29 user nova-compute[74295]:       </nova:owner>
Oct 26 06:51:29 user nova-compute[74295]:       <nova:ports>
Oct 26 06:51:29 user nova-compute[74295]:         <nova:port uuid="cb61ba87-d0f5-4081-81a5-f55a1efdec30">
Oct 26 06:51:29 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 06:51:29 user nova-compute[74295]:         </nova:port>
Oct 26 06:51:29 user nova-compute[74295]:       </nova:ports>
Oct 26 06:51:29 user nova-compute[74295]:     </nova:instance>
Oct 26 06:51:29 user nova-compute[74295]:   </metadata>
Oct 26 06:51:29 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:51:29 user nova-compute[74295]:     <system>
Oct 26 06:51:29 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:51:29 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:51:29 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:51:29 user nova-compute[74295]:       <entry name="serial">89037419-923d-4694-bf39-30f63ae4de16</entry>
Oct 26 06:51:29 user nova-compute[74295]:       <entry name="uuid">89037419-923d-4694-bf39-30f63ae4de16</entry>
Oct 26 06:51:29 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:51:29 user nova-compute[74295]:     </system>
Oct 26 06:51:29 user nova-compute[74295]:   </sysinfo>
Oct 26 06:51:29 user nova-compute[74295]:   <os>
Oct 26 06:51:29 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:51:29 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:51:29 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:51:29 user nova-compute[74295]:   </os>
Oct 26 06:51:29 user nova-compute[74295]:   <features>
Oct 26 06:51:29 user nova-compute[74295]:     <acpi/>
Oct 26 06:51:29 user nova-compute[74295]:     <apic/>
Oct 26 06:51:29 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:51:29 user nova-compute[74295]:   </features>
Oct 26 06:51:29 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:51:29 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:51:29 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:51:29 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:51:29 user nova-compute[74295]:   </clock>
Oct 26 06:51:29 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:51:29 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:51:29 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:51:29 user nova-compute[74295]:   </cpu>
Oct 26 06:51:29 user nova-compute[74295]:   <devices>
Oct 26 06:51:29 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:51:29 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:51:29 user nova-compute[74295]:       <source dev="/dev/sdd"/>
Oct 26 06:51:29 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:51:29 user nova-compute[74295]:       <serial>c9fcdae4-3465-4086-9bf4-013fc1f2c5be</serial>
Oct 26 06:51:29 user nova-compute[74295]:     </disk>
Oct 26 06:51:29 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:51:29 user nova-compute[74295]:       <mac address="fa:16:3e:07:7a:e5"/>
Oct 26 06:51:29 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:51:29 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:51:29 user nova-compute[74295]:       <target dev="tapcb61ba87-d0"/>
Oct 26 06:51:29 user nova-compute[74295]:     </interface>
Oct 26 06:51:29 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:51:29 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/89037419-923d-4694-bf39-30f63ae4de16/console.log" append="off"/>
Oct 26 06:51:29 user nova-compute[74295]:     </serial>
Oct 26 06:51:29 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:51:29 user nova-compute[74295]:     <video>
Oct 26 06:51:29 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:51:29 user nova-compute[74295]:     </video>
Oct 26 06:51:29 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:51:29 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:51:29 user nova-compute[74295]:     </rng>
Oct 26 06:51:29 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:51:29 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:51:29 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:51:29 user nova-compute[74295]:     </memballoon>
Oct 26 06:51:29 user nova-compute[74295]:   </devices>
Oct 26 06:51:29 user nova-compute[74295]: </domain>
Oct 26 06:51:29 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1802759031',display_name='tempest-TestVolumeBootPattern-server-1802759031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1802759031',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO37LOfLGVLm8denc0aiOr8WCYx77Qraf7D47fN50S5LIaTBdJywjgiKJrg/08AIIVYLPW9NSG8sjHJOCwCiCGyrZMujB/2p5ls6F3JGSk5q17MYb1TgqAWMzwRKoYJlRg==',key_name='tempest-TestVolumeBootPattern-373663211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-o73xdxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:51:08Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=89037419-923d-4694-bf39-30f63ae4de16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=cb61ba87-d0f5-4081-81a5-f55a1efdec30,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb61ba87-d0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG os_vif [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=cb61ba87-d0f5-4081-81a5-f55a1efdec30,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb61ba87-d0') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8fcfd0b-4e83-50bb-a882-87b4b3e6f5c1', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb61ba87-d0, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb61ba87-d0, col_values=(('qos', UUID('beecfa1c-b492-4d32-aa49-e4e07b9deb64')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb61ba87-d0, col_values=(('external_ids', {'iface-id': 'cb61ba87-d0f5-4081-81a5-f55a1efdec30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:7a:e5', 'vm-uuid': '89037419-923d-4694-bf39-30f63ae4de16'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:29 user nova-compute[74295]: INFO os_vif [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=cb61ba87-d0f5-4081-81a5-f55a1efdec30,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb61ba87-d0')
Oct 26 06:51:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Skipping network cache update for instance because it is Building. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No VIF found with MAC fa:16:3e:07:7a:e5, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:51:29 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:30 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updating instance_info_cache with network_info: [{"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:51:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-d05fad65-dd3a-4a04-8b42-f81313c4aca4" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:51:30 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:51:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:51:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-8c29e1bf-b95e-429d-91b9-70526b19fc3d req-08d3f88a-ba63-413c-ab25-25f36ddf37e4 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received event network-vif-plugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8c29e1bf-b95e-429d-91b9-70526b19fc3d req-08d3f88a-ba63-413c-ab25-25f36ddf37e4 service nova] Acquiring lock "89037419-923d-4694-bf39-30f63ae4de16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8c29e1bf-b95e-429d-91b9-70526b19fc3d req-08d3f88a-ba63-413c-ab25-25f36ddf37e4 service nova] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8c29e1bf-b95e-429d-91b9-70526b19fc3d req-08d3f88a-ba63-413c-ab25-25f36ddf37e4 service nova] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-8c29e1bf-b95e-429d-91b9-70526b19fc3d req-08d3f88a-ba63-413c-ab25-25f36ddf37e4 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] No waiting events found dispatching network-vif-plugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:51:31 user nova-compute[74295]: WARNING nova.compute.manager [req-8c29e1bf-b95e-429d-91b9-70526b19fc3d req-08d3f88a-ba63-413c-ab25-25f36ddf37e4 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received unexpected event network-vif-plugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 for instance with vm_state building and task_state spawning.
Oct 26 06:51:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:51:33 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Instance spawned successfully.
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-165cd39b-0592-46fa-8e48-269b2c380302 req-03c0456e-774e-4276-986d-e4d42fa618ec service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received event network-vif-plugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-165cd39b-0592-46fa-8e48-269b2c380302 req-03c0456e-774e-4276-986d-e4d42fa618ec service nova] Acquiring lock "89037419-923d-4694-bf39-30f63ae4de16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-165cd39b-0592-46fa-8e48-269b2c380302 req-03c0456e-774e-4276-986d-e4d42fa618ec service nova] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-165cd39b-0592-46fa-8e48-269b2c380302 req-03c0456e-774e-4276-986d-e4d42fa618ec service nova] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-165cd39b-0592-46fa-8e48-269b2c380302 req-03c0456e-774e-4276-986d-e4d42fa618ec service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] No waiting events found dispatching network-vif-plugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:51:33 user nova-compute[74295]: WARNING nova.compute.manager [req-165cd39b-0592-46fa-8e48-269b2c380302 req-03c0456e-774e-4276-986d-e4d42fa618ec service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received unexpected event network-vif-plugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 for instance with vm_state building and task_state spawning.
Oct 26 06:51:33 user nova-compute[74295]: INFO nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 26 06:51:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:51:33 user nova-compute[74295]: INFO nova.compute.manager [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Took 26.11 seconds to build instance.
Oct 26 06:51:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-ffa1aab6-1a47-4d2f-be46-c8b177307831 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "89037419-923d-4694-bf39-30f63ae4de16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.307s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:51 user nova-compute[74295]: INFO nova.compute.manager [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Terminating instance
Oct 26 06:51:51 user nova-compute[74295]: DEBUG nova.compute.manager [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:51:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-4fecc3b7-ee65-4938-9784-0447fe68056d req-c06fdc37-de38-4e6c-9e89-281a771fc66a service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-unplugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4fecc3b7-ee65-4938-9784-0447fe68056d req-c06fdc37-de38-4e6c-9e89-281a771fc66a service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4fecc3b7-ee65-4938-9784-0447fe68056d req-c06fdc37-de38-4e6c-9e89-281a771fc66a service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4fecc3b7-ee65-4938-9784-0447fe68056d req-c06fdc37-de38-4e6c-9e89-281a771fc66a service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-4fecc3b7-ee65-4938-9784-0447fe68056d req-c06fdc37-de38-4e6c-9e89-281a771fc66a service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-unplugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-4fecc3b7-ee65-4938-9784-0447fe68056d req-c06fdc37-de38-4e6c-9e89-281a771fc66a service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-unplugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:51:52 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Instance destroyed successfully.
Oct 26 06:51:52 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'resources' on Instance uuid d05fad65-dd3a-4a04-8b42-f81313c4aca4 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1591415229',display_name='tempest-AttachVolumeTestJSON-server-1591415229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1591415229',id=33,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7JNBP8TyOuHsG10l/IfSBEWSkkEP86O+W7m1eIwVlzmm7l/gSpZcL5vTicjil3gUPq4t2iOoKKXCyzOLUfkbOoS1QhygvZVkpBJuD4Uq8O5dAEL94jKzDS+1L+rw6ypA==',key_name='tempest-keypair-1584679424',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-io9ajpiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=d05fad65-dd3a-4a04-8b42-f81313c4aca4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "address": "fa:16:3e:ba:0d:a5", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4dc83bc-fc", "ovs_interfaceid": "f4dc83bc-fc9b-437c-a72c-e3f765165204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG os_vif [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4dc83bc-fc, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70e2e3d3-c198-403c-8289-24299c3b789c) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:52 user nova-compute[74295]: INFO os_vif [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0d:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4dc83bc-fc9b-437c-a72c-e3f765165204,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4dc83bc-fc')
Oct 26 06:51:52 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Deleting instance files /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4_del
Oct 26 06:51:52 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Deletion of /opt/stack/data/nova/instances/d05fad65-dd3a-4a04-8b42-f81313c4aca4_del complete
Oct 26 06:51:52 user nova-compute[74295]: INFO nova.compute.manager [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 06:51:52 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:51:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:53 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:51:53 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Took 0.91 seconds to deallocate network for instance.
Oct 26 06:51:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:53 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:51:53 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:51:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:53 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Deleted allocations for instance d05fad65-dd3a-4a04-8b42-f81313c4aca4
Oct 26 06:51:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f8ec98f0-187d-483b-91e1-f05b9405873c tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.286s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-ed1133f6-c939-4929-9506-7e2da9f06330 req-16a5a3fa-3029-4c86-9a56-4a77721a8bc7 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:51:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ed1133f6-c939-4929-9506-7e2da9f06330 req-16a5a3fa-3029-4c86-9a56-4a77721a8bc7 service nova] Acquiring lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:51:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ed1133f6-c939-4929-9506-7e2da9f06330 req-16a5a3fa-3029-4c86-9a56-4a77721a8bc7 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:51:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-ed1133f6-c939-4929-9506-7e2da9f06330 req-16a5a3fa-3029-4c86-9a56-4a77721a8bc7 service nova] Lock "d05fad65-dd3a-4a04-8b42-f81313c4aca4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:51:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-ed1133f6-c939-4929-9506-7e2da9f06330 req-16a5a3fa-3029-4c86-9a56-4a77721a8bc7 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] No waiting events found dispatching network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:51:54 user nova-compute[74295]: WARNING nova.compute.manager [req-ed1133f6-c939-4929-9506-7e2da9f06330 req-16a5a3fa-3029-4c86-9a56-4a77721a8bc7 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received unexpected event network-vif-plugged-f4dc83bc-fc9b-437c-a72c-e3f765165204 for instance with vm_state deleted and task_state None.
Oct 26 06:51:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-ed1133f6-c939-4929-9506-7e2da9f06330 req-16a5a3fa-3029-4c86-9a56-4a77721a8bc7 service nova] [instance: d05fad65-dd3a-4a04-8b42-f81313c4aca4] Received event network-vif-deleted-f4dc83bc-fc9b-437c-a72c-e3f765165204 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:51:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:51:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-5687552c-b645-4e6d-b20a-3ceae964ba20 req-df6378c9-33ea-465a-89ac-6f3067b00baf service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received event network-changed-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:52:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-5687552c-b645-4e6d-b20a-3ceae964ba20 req-df6378c9-33ea-465a-89ac-6f3067b00baf service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Refreshing instance network info cache due to event network-changed-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:52:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5687552c-b645-4e6d-b20a-3ceae964ba20 req-df6378c9-33ea-465a-89ac-6f3067b00baf service nova] Acquiring lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:52:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5687552c-b645-4e6d-b20a-3ceae964ba20 req-df6378c9-33ea-465a-89ac-6f3067b00baf service nova] Acquired lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:52:01 user nova-compute[74295]: DEBUG nova.network.neutron [req-5687552c-b645-4e6d-b20a-3ceae964ba20 req-df6378c9-33ea-465a-89ac-6f3067b00baf service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Refreshing network info cache for port c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:52:01 user nova-compute[74295]: DEBUG nova.network.neutron [req-5687552c-b645-4e6d-b20a-3ceae964ba20 req-df6378c9-33ea-465a-89ac-6f3067b00baf service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updated VIF entry in instance network info cache for port c1ace45a-5d04-4dd3-a5f9-f5c3256e951f. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:52:01 user nova-compute[74295]: DEBUG nova.network.neutron [req-5687552c-b645-4e6d-b20a-3ceae964ba20 req-df6378c9-33ea-465a-89ac-6f3067b00baf service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating instance_info_cache with network_info: [{"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:52:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5687552c-b645-4e6d-b20a-3ceae964ba20 req-df6378c9-33ea-465a-89ac-6f3067b00baf service nova] Releasing lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:52:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:07 user nova-compute[74295]: DEBUG nova.objects.instance [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:52:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:08 user nova-compute[74295]: INFO nova.compute.manager [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attaching volume f15de999-635a-4e50-9d7e-c15473b9164a to /dev/vdb
Oct 26 06:52:08 user nova-compute[74295]: DEBUG os_brick.utils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b050d3d-f7b1-4f32-9f79-6c3e7dc8d3b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a435f9-7e95-4901-a021-2f6a827c06ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[02610861-e355-4b2a-988d-b20dd51a12f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[528e1a1f-a6a7-4f98-a917-965b164d15eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:52:08 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:52:08 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0c12c2-dbdf-466a-bed1-1116d5eb0386]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG os_brick.utils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:52:08 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating existing volume attachment record: 5186ed0a-5278-4c09-9e2b-c432413e0858 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:52:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:17 user nova-compute[74295]: INFO nova.compute.manager [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Detaching volume c8b7a677-3669-4522-a1e5-747e09d94dd1
Oct 26 06:52:17 user nova-compute[74295]: INFO nova.virt.block_device [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Attempting to driver detach volume c8b7a677-3669-4522-a1e5-747e09d94dd1 from mountpoint /dev/vdb
Oct 26 06:52:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Attempting to detach device vdb from instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:52:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:52:17 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:52:17 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:52:17 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:52:17 user nova-compute[74295]:   <serial>c8b7a677-3669-4522-a1e5-747e09d94dd1</serial>
Oct 26 06:52:17 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:52:17 user nova-compute[74295]: </disk>
Oct 26 06:52:17 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:52:17 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Successfully detached device vdb from instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 from the persistent domain config.
Oct 26 06:52:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:52:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:52:17 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:52:17 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 06:52:17 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:52:17 user nova-compute[74295]:   <serial>c8b7a677-3669-4522-a1e5-747e09d94dd1</serial>
Oct 26 06:52:17 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:52:17 user nova-compute[74295]: </disk>
Oct 26 06:52:17 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:52:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:52:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:22 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:22 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:52:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.344s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:24 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:52:24 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8326MB free_disk=25.162757873535156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cfde0bac-90db-40c0-90c6-957b2baf948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 89037419-923d-4694-bf39-30f63ae4de16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 06:52:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 06:52:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxamrbvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:52:26 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:52:26 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:52:26 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5ac73a-0f2b-493a-8d63-a00a74245dee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:52:26 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b639b139-a7aa-40d1-a3f3-d48e519cc992]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a] added
Oct 26 06:52:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a824a7-89eb-4acb-b008-59c3e95250ad]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[383d9d26-2d73-4e25-91de-aab2b7b4ee77]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxamrbvY {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxamrbvY" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07c8815-4fe4-4ddd-b94b-8fb09e9694c5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dxamrbvY'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a15b46-c360-4407-8d4e-3daf6d3906b3]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e85c0b9-02b6-40e5-a87b-3f5accbeb092]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:52:26 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:26 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:52:26 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:26 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2773f6cd-dbd2-4927-8c18-394289fa3901]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a, portal: 172.16.0.220,3260]
Oct 26 06:52:26 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a, portal: 172.16.0.220,3260] successful.
Oct 26 06:52:26 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65e84fc-45b7-4b82-b016-54a5c05f5051]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[78347aad-4c68-45bc-b374-cabcfe52b016]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:52:27 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:27 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:27 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:52:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:52:27 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:27 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:27 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:52:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[095bcc3b-a3ca-4ad5-a474-737c5767e4dc]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxamrbvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:52:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:52:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:52:28 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26361353231306332', 'path': '/dev/sde'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:52:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361353231306332', 'path': '/dev/sde'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:52:28 user nova-compute[74295]: DEBUG nova.objects.instance [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:52:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:52:28 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:52:28 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:52:28 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:52:28 user nova-compute[74295]:   <serial>f15de999-635a-4e50-9d7e-c15473b9164a</serial>
Oct 26 06:52:28 user nova-compute[74295]: </disk>
Oct 26 06:52:28 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:52:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:52:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:52:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No VIF found with MAC fa:16:3e:dd:27:97, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:52:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-15b3f54e-bf61-4f4c-b28c-bd91b880c327 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.618s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:30 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:52:30 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Skipping network cache update for instance because it is being deleted. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 26 06:52:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:52:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:52:30 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: a1a69164-d3a5-4531-a067-161923f10060] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:52:31 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating instance_info_cache with network_info: [{"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:52:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:52:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:52:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 06:52:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:32 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:52:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:52:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:52:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:52:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:37 user nova-compute[74295]: INFO nova.compute.manager [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Detaching volume 24f5da3d-6be1-48f0-8a24-40fe5bacd713
Oct 26 06:52:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:37 user nova-compute[74295]: INFO nova.virt.block_device [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Attempting to driver detach volume 24f5da3d-6be1-48f0-8a24-40fe5bacd713 from mountpoint /dev/vdc
Oct 26 06:52:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Attempting to detach device vdc from instance cfde0bac-90db-40c0-90c6-957b2baf948c from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:52:37 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:52:37 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:52:37 user nova-compute[74295]:   <target dev="vdc" bus="virtio"/>
Oct 26 06:52:37 user nova-compute[74295]:   <serial>24f5da3d-6be1-48f0-8a24-40fe5bacd713</serial>
Oct 26 06:52:37 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 06:52:37 user nova-compute[74295]: </disk>
Oct 26 06:52:37 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:52:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully detached device vdc from instance cfde0bac-90db-40c0-90c6-957b2baf948c from the persistent domain config.
Oct 26 06:52:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cfde0bac-90db-40c0-90c6-957b2baf948c from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:52:37 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:52:37 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:52:37 user nova-compute[74295]:   <target dev="vdc" bus="virtio"/>
Oct 26 06:52:37 user nova-compute[74295]:   <serial>24f5da3d-6be1-48f0-8a24-40fe5bacd713</serial>
Oct 26 06:52:37 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 06:52:37 user nova-compute[74295]: </disk>
Oct 26 06:52:37 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:37 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 is timed out.
Oct 26 06:52:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Successfully detached device vdb from instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6 from the live domain config.
Oct 26 06:52:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpvGNQqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:52:37 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba4a412-81dc-4347-bcc6-b2455c5b8a29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:52:37 user nova-compute[74295]: No targets found.
Oct 26 06:52:37 user nova-compute[74295]: iSNS:
Oct 26 06:52:37 user nova-compute[74295]: No targets found.
Oct 26 06:52:37 user nova-compute[74295]: STATIC:
Oct 26 06:52:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a
Oct 26 06:52:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713
Oct 26 06:52:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1
Oct 26 06:52:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:52:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:37 user nova-compute[74295]: FIRMWARE:
Oct 26 06:52:37 user nova-compute[74295]: No targets found.
Oct 26 06:52:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:52:37 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:52:37 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bb52d2-8ffa-4744-a9a4-a0885e0a6e75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44fa8fe-0204-4369-bb7b-d10f921d43ce]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:52:37 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:37 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:37 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:52:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 (non-flash)
Oct 26 06:52:37 user nova-compute[74295]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:37 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:37 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:52:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac5072e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a52268-e162-4b28-b822-2bfebb3f545e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9232dc40-ba0a-4f08-9d28-358257aa18ee]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c11ef6-b868-4151-b666-820cdb83d58b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:52:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c12337-48ca-4e9c-9dc7-ca0f8d6803ff]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4783de3-bbcd-4b1b-9a01-62e139cd8614]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2720763-2db0-4622-9b12-f88b60965824]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1, portal: 172.16.0.220,3260]
Oct 26 06:52:38 user nova-compute[74295]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1, portal: 172.16.0.220,3260] successful.
Oct 26 06:52:38 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[564eeb71-d4fc-47d1-b1d0-e6afdaf63fe7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] <== disconnect_volume: return (328ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:38 user nova-compute[74295]: DEBUG nova.objects.instance [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'flavor' on Instance uuid ac34132a-3908-4cc8-b65f-bc2ed005ccf6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dbb6649d-812d-4310-8ebd-922d4a5f1d9c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.856s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.714s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:39 user nova-compute[74295]: INFO nova.compute.manager [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Terminating instance
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-c6882b63-cae2-4244-970b-b7f6823fdae2 req-597997d8-9dd0-4076-ab69-5c0daa48b60e service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received event network-vif-unplugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c6882b63-cae2-4244-970b-b7f6823fdae2 req-597997d8-9dd0-4076-ab69-5c0daa48b60e service nova] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c6882b63-cae2-4244-970b-b7f6823fdae2 req-597997d8-9dd0-4076-ab69-5c0daa48b60e service nova] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c6882b63-cae2-4244-970b-b7f6823fdae2 req-597997d8-9dd0-4076-ab69-5c0daa48b60e service nova] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-c6882b63-cae2-4244-970b-b7f6823fdae2 req-597997d8-9dd0-4076-ab69-5c0daa48b60e service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] No waiting events found dispatching network-vif-unplugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.compute.manager [req-c6882b63-cae2-4244-970b-b7f6823fdae2 req-597997d8-9dd0-4076-ab69-5c0daa48b60e service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received event network-vif-unplugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:52:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Instance destroyed successfully.
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.objects.instance [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'resources' on Instance uuid ac34132a-3908-4cc8-b65f-bc2ed005ccf6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-570857666',display_name='tempest-VolumesSnapshotTestJSON-instance-570857666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-570857666',id=40,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/c+989snAmr7cDlzc3w+k3zvnIJuRYeTB9ABhWdyywZ7s/K+bgtxrNZh0mOA65jVgpt9CXTnDwS8rcAKWXcRtDVTKfQzbEcz0DbGcmG/mqDUUt4GVwYxlVcr8TBbBWuA==',key_name='tempest-keypair-1476096408',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b43980edd6fd428a94283c56a896d717',ramdisk_id='',reservation_id='r-bg0m5j16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1927708355',owner_user_name='tempest-VolumesSnapshotTestJSON-1927708355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01f2b3710476458abc998271a7047156',uuid=ac34132a-3908-4cc8-b65f-bc2ed005ccf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converting VIF {"id": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "address": "fa:16:3e:98:a0:9b", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c1cebd-71", "ovs_interfaceid": "43c1cebd-71b0-4cf9-bc83-a5c15667c63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:a0:9b,bridge_name='br-int',has_traffic_filtering=True,id=43c1cebd-71b0-4cf9-bc83-a5c15667c63b,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c1cebd-71') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_vif [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:a0:9b,bridge_name='br-int',has_traffic_filtering=True,id=43c1cebd-71b0-4cf9-bc83-a5c15667c63b,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c1cebd-71') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43c1cebd-71, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfcd3333-7ee7-43b3-b620-593f6399f613) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:52:39 user nova-compute[74295]: INFO os_vif [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:a0:9b,bridge_name='br-int',has_traffic_filtering=True,id=43c1cebd-71b0-4cf9-bc83-a5c15667c63b,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c1cebd-71')
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpvGNQqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:52:39 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[824cf96b-1e7e-4096-a35b-9ed0db9e2ed3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:52:39 user nova-compute[74295]: No targets found.
Oct 26 06:52:39 user nova-compute[74295]: iSNS:
Oct 26 06:52:39 user nova-compute[74295]: No targets found.
Oct 26 06:52:39 user nova-compute[74295]: STATIC:
Oct 26 06:52:39 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a
Oct 26 06:52:39 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:39 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:39 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713
Oct 26 06:52:39 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:39 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:39 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:52:39 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:39 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:39 user nova-compute[74295]: FIRMWARE:
Oct 26 06:52:39 user nova-compute[74295]: No targets found.
Oct 26 06:52:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:52:39 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:52:39 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8b7a677-3669-4522-a1e5-747e09d94dd1', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[817380e3-e4a4-4cbf-acd6-f44dea750259]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[884aaeb0-f30b-4fac-89ba-f7fab20a480d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:39 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:39 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:52:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:39 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:39 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:52:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35886da7a0>, {}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Disconnecting from: [] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] <== disconnect_volume: return (72ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:52:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:52:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Deleting instance files /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6_del
Oct 26 06:52:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Deletion of /opt/stack/data/nova/instances/ac34132a-3908-4cc8-b65f-bc2ed005ccf6_del complete
Oct 26 06:52:40 user nova-compute[74295]: INFO nova.compute.manager [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 26 06:52:40 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:52:40 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:52:40 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:52:40 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:52:40 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Took 0.67 seconds to deallocate network for instance.
Oct 26 06:52:40 user nova-compute[74295]: WARNING nova.volume.cinder [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Attachment 3bf90fa1-8489-4fe9-b57c-4c7cd6e47eef does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3bf90fa1-8489-4fe9-b57c-4c7cd6e47eef. (HTTP 404) (Request-ID: req-5a34c2f2-718d-4f65-af35-8da5e6372e86)
Oct 26 06:52:40 user nova-compute[74295]: INFO nova.compute.manager [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Took 0.03 seconds to detach 1 volumes for instance.
Oct 26 06:52:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:40 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:52:40 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:52:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:41 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Deleted allocations for instance ac34132a-3908-4cc8-b65f-bc2ed005ccf6
Oct 26 06:52:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-de801174-1fdb-4727-9b04-468e1648d80c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.094s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-8f8a7b02-a1d6-4353-8696-08417cb5d150 req-0db7c286-75ad-4caf-8aa8-3e6a8b8c4e55 service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received event network-vif-plugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:52:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8f8a7b02-a1d6-4353-8696-08417cb5d150 req-0db7c286-75ad-4caf-8aa8-3e6a8b8c4e55 service nova] Acquiring lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8f8a7b02-a1d6-4353-8696-08417cb5d150 req-0db7c286-75ad-4caf-8aa8-3e6a8b8c4e55 service nova] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8f8a7b02-a1d6-4353-8696-08417cb5d150 req-0db7c286-75ad-4caf-8aa8-3e6a8b8c4e55 service nova] Lock "ac34132a-3908-4cc8-b65f-bc2ed005ccf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-8f8a7b02-a1d6-4353-8696-08417cb5d150 req-0db7c286-75ad-4caf-8aa8-3e6a8b8c4e55 service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] No waiting events found dispatching network-vif-plugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:52:41 user nova-compute[74295]: WARNING nova.compute.manager [req-8f8a7b02-a1d6-4353-8696-08417cb5d150 req-0db7c286-75ad-4caf-8aa8-3e6a8b8c4e55 service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received unexpected event network-vif-plugged-43c1cebd-71b0-4cf9-bc83-a5c15667c63b for instance with vm_state deleted and task_state None.
Oct 26 06:52:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-8f8a7b02-a1d6-4353-8696-08417cb5d150 req-0db7c286-75ad-4caf-8aa8-3e6a8b8c4e55 service nova] [instance: ac34132a-3908-4cc8-b65f-bc2ed005ccf6] Received event network-vif-deleted-43c1cebd-71b0-4cf9-bc83-a5c15667c63b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:52:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:52:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:52:45 user nova-compute[74295]: INFO nova.compute.claims [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Claim successful on node user
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:52:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.policy [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c0aa0cb8a174036bb890dca38df6e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f36efc5cdc4cf5a61b0807a1235ba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:52:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Creating image(s)
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "/opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "/opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "/opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk 1073741824" returned: 0 in 0.057s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Successfully created port: a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Cannot resize image /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Ensure instance console log exists: /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Successfully updated port: a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquired lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-acb77f80-a597-47a2-8d4a-73883b0b87db req-f3b743d0-18ed-4f10-af24-0acb4bcceed9 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received event network-changed-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-acb77f80-a597-47a2-8d4a-73883b0b87db req-f3b743d0-18ed-4f10-af24-0acb4bcceed9 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Refreshing instance network info cache due to event network-changed-a3411818-f27e-4611-bd69-b00b67614770. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-acb77f80-a597-47a2-8d4a-73883b0b87db req-f3b743d0-18ed-4f10-af24-0acb4bcceed9 service nova] Acquiring lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updating instance_info_cache with network_info: [{"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Releasing lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Instance network_info: |[{"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-acb77f80-a597-47a2-8d4a-73883b0b87db req-f3b743d0-18ed-4f10-af24-0acb4bcceed9 service nova] Acquired lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.network.neutron [req-acb77f80-a597-47a2-8d4a-73883b0b87db req-f3b743d0-18ed-4f10-af24-0acb4bcceed9 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Refreshing network info cache for port a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Start _get_guest_xml network_info=[{"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:52:47 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:52:47 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1192256602',display_name='tempest-AttachVolumeTestJSON-server-1192256602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1192256602',id=43,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaLR1LI9Y9KTldYRDrRbERgqew4a8dUX1e56hGwSPugjNzCGrzdlRMgAQyqCRQfO2UbnKi7CYtmsHhxRpuZq9V2tz2EUceaV992hWp0hLmCdV05S0DKR1SSW6Dflp02kg==',key_name='tempest-keypair-1292959742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-8dgxhd6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=69104a0e-4896-4677-999c-1e5173103e8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:01:06,bridge_name='br-int',has_traffic_filtering=True,id=a3411818-f27e-4611-bd69-b00b67614770,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3411818-f2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'pci_devices' on Instance uuid 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:52:47 user nova-compute[74295]:   <uuid>69104a0e-4896-4677-999c-1e5173103e8b</uuid>
Oct 26 06:52:47 user nova-compute[74295]:   <name>instance-0000002b</name>
Oct 26 06:52:47 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:52:47 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:52:47 user nova-compute[74295]:   <metadata>
Oct 26 06:52:47 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:52:47 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:52:47 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeTestJSON-server-1192256602</nova:name>
Oct 26 06:52:47 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:52:47</nova:creationTime>
Oct 26 06:52:47 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:52:47 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:52:47 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:52:47 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:52:47 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:52:47 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:52:47 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:52:47 user nova-compute[74295]:       <nova:owner>
Oct 26 06:52:47 user nova-compute[74295]:         <nova:user uuid="7c0aa0cb8a174036bb890dca38df6e7d">tempest-AttachVolumeTestJSON-93311543-project-member</nova:user>
Oct 26 06:52:47 user nova-compute[74295]:         <nova:project uuid="b5f36efc5cdc4cf5a61b0807a1235ba4">tempest-AttachVolumeTestJSON-93311543</nova:project>
Oct 26 06:52:47 user nova-compute[74295]:       </nova:owner>
Oct 26 06:52:47 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:52:47 user nova-compute[74295]:       <nova:ports>
Oct 26 06:52:47 user nova-compute[74295]:         <nova:port uuid="a3411818-f27e-4611-bd69-b00b67614770">
Oct 26 06:52:47 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 06:52:47 user nova-compute[74295]:         </nova:port>
Oct 26 06:52:47 user nova-compute[74295]:       </nova:ports>
Oct 26 06:52:47 user nova-compute[74295]:     </nova:instance>
Oct 26 06:52:47 user nova-compute[74295]:   </metadata>
Oct 26 06:52:47 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:52:47 user nova-compute[74295]:     <system>
Oct 26 06:52:47 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:52:47 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:52:47 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:52:47 user nova-compute[74295]:       <entry name="serial">69104a0e-4896-4677-999c-1e5173103e8b</entry>
Oct 26 06:52:47 user nova-compute[74295]:       <entry name="uuid">69104a0e-4896-4677-999c-1e5173103e8b</entry>
Oct 26 06:52:47 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:52:47 user nova-compute[74295]:     </system>
Oct 26 06:52:47 user nova-compute[74295]:   </sysinfo>
Oct 26 06:52:47 user nova-compute[74295]:   <os>
Oct 26 06:52:47 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:52:47 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:52:47 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:52:47 user nova-compute[74295]:   </os>
Oct 26 06:52:47 user nova-compute[74295]:   <features>
Oct 26 06:52:47 user nova-compute[74295]:     <acpi/>
Oct 26 06:52:47 user nova-compute[74295]:     <apic/>
Oct 26 06:52:47 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:52:47 user nova-compute[74295]:   </features>
Oct 26 06:52:47 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:52:47 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:52:47 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:52:47 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:52:47 user nova-compute[74295]:   </clock>
Oct 26 06:52:47 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:52:47 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:52:47 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:52:47 user nova-compute[74295]:   </cpu>
Oct 26 06:52:47 user nova-compute[74295]:   <devices>
Oct 26 06:52:47 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:52:47 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:52:47 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk"/>
Oct 26 06:52:47 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:52:47 user nova-compute[74295]:     </disk>
Oct 26 06:52:47 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:52:47 user nova-compute[74295]:       <mac address="fa:16:3e:ce:01:06"/>
Oct 26 06:52:47 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:52:47 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:52:47 user nova-compute[74295]:       <target dev="tapa3411818-f2"/>
Oct 26 06:52:47 user nova-compute[74295]:     </interface>
Oct 26 06:52:47 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:52:47 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/console.log" append="off"/>
Oct 26 06:52:47 user nova-compute[74295]:     </serial>
Oct 26 06:52:47 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:52:47 user nova-compute[74295]:     <video>
Oct 26 06:52:47 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:52:47 user nova-compute[74295]:     </video>
Oct 26 06:52:47 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:52:47 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:52:47 user nova-compute[74295]:     </rng>
Oct 26 06:52:47 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:52:47 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:52:47 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:52:47 user nova-compute[74295]:     </memballoon>
Oct 26 06:52:47 user nova-compute[74295]:   </devices>
Oct 26 06:52:47 user nova-compute[74295]: </domain>
Oct 26 06:52:47 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1192256602',display_name='tempest-AttachVolumeTestJSON-server-1192256602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1192256602',id=43,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaLR1LI9Y9KTldYRDrRbERgqew4a8dUX1e56hGwSPugjNzCGrzdlRMgAQyqCRQfO2UbnKi7CYtmsHhxRpuZq9V2tz2EUceaV992hWp0hLmCdV05S0DKR1SSW6Dflp02kg==',key_name='tempest-keypair-1292959742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-8dgxhd6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=69104a0e-4896-4677-999c-1e5173103e8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:01:06,bridge_name='br-int',has_traffic_filtering=True,id=a3411818-f27e-4611-bd69-b00b67614770,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3411818-f2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG os_vif [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:01:06,bridge_name='br-int',has_traffic_filtering=True,id=a3411818-f27e-4611-bd69-b00b67614770,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3411818-f2') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c7fb194-4fc0-51f1-958e-e2760bdbedd9', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3411818-f2, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3411818-f2, col_values=(('qos', UUID('332d7ee8-2539-44a2-828f-315012696485')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3411818-f2, col_values=(('external_ids', {'iface-id': 'a3411818-f27e-4611-bd69-b00b67614770', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:01:06', 'vm-uuid': '69104a0e-4896-4677-999c-1e5173103e8b'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:52:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:47 user nova-compute[74295]: INFO os_vif [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:01:06,bridge_name='br-int',has_traffic_filtering=True,id=a3411818-f27e-4611-bd69-b00b67614770,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3411818-f2')
Oct 26 06:52:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:52:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No VIF found with MAC fa:16:3e:ce:01:06, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:52:48 user nova-compute[74295]: DEBUG nova.network.neutron [req-acb77f80-a597-47a2-8d4a-73883b0b87db req-f3b743d0-18ed-4f10-af24-0acb4bcceed9 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updated VIF entry in instance network info cache for port a3411818-f27e-4611-bd69-b00b67614770. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:52:48 user nova-compute[74295]: DEBUG nova.network.neutron [req-acb77f80-a597-47a2-8d4a-73883b0b87db req-f3b743d0-18ed-4f10-af24-0acb4bcceed9 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updating instance_info_cache with network_info: [{"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:52:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-acb77f80-a597-47a2-8d4a-73883b0b87db req-f3b743d0-18ed-4f10-af24-0acb4bcceed9 service nova] Releasing lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:52:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-6790f6f5-9734-4ff2-9f33-a51f96dbf5f8 req-c6b6f379-8988-42e4-973e-d14a4a886da2 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received event network-vif-plugged-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:52:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6790f6f5-9734-4ff2-9f33-a51f96dbf5f8 req-c6b6f379-8988-42e4-973e-d14a4a886da2 service nova] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6790f6f5-9734-4ff2-9f33-a51f96dbf5f8 req-c6b6f379-8988-42e4-973e-d14a4a886da2 service nova] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6790f6f5-9734-4ff2-9f33-a51f96dbf5f8 req-c6b6f379-8988-42e4-973e-d14a4a886da2 service nova] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:49 user nova-compute[74295]: DEBUG nova.compute.manager [req-6790f6f5-9734-4ff2-9f33-a51f96dbf5f8 req-c6b6f379-8988-42e4-973e-d14a4a886da2 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] No waiting events found dispatching network-vif-plugged-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:52:49 user nova-compute[74295]: WARNING nova.compute.manager [req-6790f6f5-9734-4ff2-9f33-a51f96dbf5f8 req-c6b6f379-8988-42e4-973e-d14a4a886da2 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received unexpected event network-vif-plugged-a3411818-f27e-4611-bd69-b00b67614770 for instance with vm_state building and task_state spawning.
Oct 26 06:52:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-4454c1bf-c85f-4cdd-bc64-bd828cae0dbd req-98b16400-e056-4101-878e-6e93b5d36f01 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received event network-vif-plugged-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:52:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4454c1bf-c85f-4cdd-bc64-bd828cae0dbd req-98b16400-e056-4101-878e-6e93b5d36f01 service nova] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:52:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4454c1bf-c85f-4cdd-bc64-bd828cae0dbd req-98b16400-e056-4101-878e-6e93b5d36f01 service nova] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:52:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4454c1bf-c85f-4cdd-bc64-bd828cae0dbd req-98b16400-e056-4101-878e-6e93b5d36f01 service nova] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:51 user nova-compute[74295]: DEBUG nova.compute.manager [req-4454c1bf-c85f-4cdd-bc64-bd828cae0dbd req-98b16400-e056-4101-878e-6e93b5d36f01 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] No waiting events found dispatching network-vif-plugged-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:52:51 user nova-compute[74295]: WARNING nova.compute.manager [req-4454c1bf-c85f-4cdd-bc64-bd828cae0dbd req-98b16400-e056-4101-878e-6e93b5d36f01 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received unexpected event network-vif-plugged-a3411818-f27e-4611-bd69-b00b67614770 for instance with vm_state building and task_state spawning.
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:52:52 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Instance spawned successfully.
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:52:52 user nova-compute[74295]: INFO nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Took 5.90 seconds to spawn the instance on the hypervisor.
Oct 26 06:52:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:52:52 user nova-compute[74295]: INFO nova.compute.manager [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Took 6.52 seconds to build instance.
Oct 26 06:52:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3e32b743-c996-4cfb-8851-8524f6ea18a3 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.844s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:52:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:52:58 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance cfde0bac-90db-40c0-90c6-957b2baf948c is timed out.
Oct 26 06:52:58 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully detached device vdc from instance cfde0bac-90db-40c0-90c6-957b2baf948c from the live domain config.
Oct 26 06:52:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdpQwKux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:52:58 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e790eed-cca4-459e-bc1a-a1b4e598ca04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:52:58 user nova-compute[74295]: No targets found.
Oct 26 06:52:58 user nova-compute[74295]: iSNS:
Oct 26 06:52:58 user nova-compute[74295]: No targets found.
Oct 26 06:52:58 user nova-compute[74295]: STATIC:
Oct 26 06:52:58 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a
Oct 26 06:52:58 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:58 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:58 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713
Oct 26 06:52:58 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:58 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:58 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:52:58 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:52:58 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:52:58 user nova-compute[74295]: FIRMWARE:
Oct 26 06:52:58 user nova-compute[74295]: No targets found.
Oct 26 06:52:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:52:58 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:52:58 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb40d6d-ca20-46ca-a5ae-9f7d5bff7f28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[587c8ec3-b718-4d18-9b20-1fb547ec4259]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:58 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:58 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:52:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 (non-flash)
Oct 26 06:52:58 user nova-compute[74295]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:52:58 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:52:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35886c6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ed4e3f-2d14-4c24-a492-881f55f29667]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[44248eba-44b5-4282-bc82-3d8420e6e2d0]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e196bd28-3c6d-4436-a490-925c09a773b7]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b299bc8-af09-43f0-85e1-6bc3e5f26025]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec8c4e3-7db9-4e7f-b0d6-51d9261ee86f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7fdc76-8dbe-4dbe-87ce-ed93abd30b4f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713, portal: 172.16.0.220,3260]
Oct 26 06:52:58 user nova-compute[74295]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713, portal: 172.16.0.220,3260] successful.
Oct 26 06:52:58 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24f5da3d-6be1-48f0-8a24-40fe5bacd713 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b86681c-e050-4762-a1ba-66f77784ae5f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] <== disconnect_volume: return (328ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:52:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG nova.objects.instance [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'flavor' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4372764d-bbb5-4bd7-ab49-f193d360c4a6 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.848s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-d3c18710-3d84-4f02-bb8d-8c6a1af08c09 req-3eeb1266-ec4f-4dee-ab36-de67660ab472 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received event network-changed-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-d3c18710-3d84-4f02-bb8d-8c6a1af08c09 req-3eeb1266-ec4f-4dee-ab36-de67660ab472 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Refreshing instance network info cache due to event network-changed-cb61ba87-d0f5-4081-81a5-f55a1efdec30. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d3c18710-3d84-4f02-bb8d-8c6a1af08c09 req-3eeb1266-ec4f-4dee-ab36-de67660ab472 service nova] Acquiring lock "refresh_cache-89037419-923d-4694-bf39-30f63ae4de16" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d3c18710-3d84-4f02-bb8d-8c6a1af08c09 req-3eeb1266-ec4f-4dee-ab36-de67660ab472 service nova] Acquired lock "refresh_cache-89037419-923d-4694-bf39-30f63ae4de16" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-d3c18710-3d84-4f02-bb8d-8c6a1af08c09 req-3eeb1266-ec4f-4dee-ab36-de67660ab472 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Refreshing network info cache for port cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-d3c18710-3d84-4f02-bb8d-8c6a1af08c09 req-3eeb1266-ec4f-4dee-ab36-de67660ab472 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Updated VIF entry in instance network info cache for port cb61ba87-d0f5-4081-81a5-f55a1efdec30. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-d3c18710-3d84-4f02-bb8d-8c6a1af08c09 req-3eeb1266-ec4f-4dee-ab36-de67660ab472 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Updating instance_info_cache with network_info: [{"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:52:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d3c18710-3d84-4f02-bb8d-8c6a1af08c09 req-3eeb1266-ec4f-4dee-ab36-de67660ab472 service nova] Releasing lock "refresh_cache-89037419-923d-4694-bf39-30f63ae4de16" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "89037419-923d-4694-bf39-30f63ae4de16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "89037419-923d-4694-bf39-30f63ae4de16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "89037419-923d-4694-bf39-30f63ae4de16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:00 user nova-compute[74295]: INFO nova.compute.manager [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Terminating instance
Oct 26 06:53:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-910cdbb8-eb19-4509-9e4a-d68fd7035316 req-1bd5820b-3e41-48c3-a864-c37d33d9370c service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received event network-vif-unplugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-910cdbb8-eb19-4509-9e4a-d68fd7035316 req-1bd5820b-3e41-48c3-a864-c37d33d9370c service nova] Acquiring lock "89037419-923d-4694-bf39-30f63ae4de16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-910cdbb8-eb19-4509-9e4a-d68fd7035316 req-1bd5820b-3e41-48c3-a864-c37d33d9370c service nova] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-910cdbb8-eb19-4509-9e4a-d68fd7035316 req-1bd5820b-3e41-48c3-a864-c37d33d9370c service nova] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-910cdbb8-eb19-4509-9e4a-d68fd7035316 req-1bd5820b-3e41-48c3-a864-c37d33d9370c service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] No waiting events found dispatching network-vif-unplugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG nova.compute.manager [req-910cdbb8-eb19-4509-9e4a-d68fd7035316 req-1bd5820b-3e41-48c3-a864-c37d33d9370c service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received event network-vif-unplugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:53:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Instance destroyed successfully.
Oct 26 06:53:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'resources' on Instance uuid 89037419-923d-4694-bf39-30f63ae4de16 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1802759031',display_name='tempest-TestVolumeBootPattern-server-1802759031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1802759031',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO37LOfLGVLm8denc0aiOr8WCYx77Qraf7D47fN50S5LIaTBdJywjgiKJrg/08AIIVYLPW9NSG8sjHJOCwCiCGyrZMujB/2p5ls6F3JGSk5q17MYb1TgqAWMzwRKoYJlRg==',key_name='tempest-TestVolumeBootPattern-373663211',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:51:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-o73xdxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:51:33Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=89037419-923d-4694-bf39-30f63ae4de16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "address": "fa:16:3e:07:7a:e5", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb61ba87-d0", "ovs_interfaceid": "cb61ba87-d0f5-4081-81a5-f55a1efdec30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=cb61ba87-d0f5-4081-81a5-f55a1efdec30,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb61ba87-d0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG os_vif [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=cb61ba87-d0f5-4081-81a5-f55a1efdec30,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb61ba87-d0') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb61ba87-d0, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=beecfa1c-b492-4d32-aa49-e4e07b9deb64) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:53:00 user nova-compute[74295]: INFO os_vif [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:7a:e5,bridge_name='br-int',has_traffic_filtering=True,id=cb61ba87-d0f5-4081-81a5-f55a1efdec30,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb61ba87-d0')
Oct 26 06:53:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSYcHXpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:53:00 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:53:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcbdeaa-b9af-46b9-a34c-1f5bc6cd2397]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:53:00 user nova-compute[74295]: No targets found.
Oct 26 06:53:00 user nova-compute[74295]: iSNS:
Oct 26 06:53:00 user nova-compute[74295]: No targets found.
Oct 26 06:53:00 user nova-compute[74295]: STATIC:
Oct 26 06:53:00 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a
Oct 26 06:53:00 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:53:00 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:53:00 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:53:00 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:53:00 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:53:00 user nova-compute[74295]: FIRMWARE:
Oct 26 06:53:00 user nova-compute[74295]: No targets found.
Oct 26 06:53:00 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:53:00 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:53:00 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee153c9e-ca14-40c5-9d6c-f32bdb66ddf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e3f1d5-5e0b-468d-b7fc-e30dcb793591]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:53:01 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:53:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:53:01 user nova-compute[74295]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:53:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac5127a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[785b8812-0fbc-4659-85d8-911c994293b4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8f595e-1f17-4c8c-8ef4-85bbbb7b985f]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaa4366-56d5-4451-bd6c-34d52768b7ca]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb3109a-01db-4444-84be-e60b104af6c4]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12fc7da-09c3-4c5b-9103-4d8db4a84d36]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --logout" returned: 0 in 0.145s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cca317-bbc6-40d0-836c-b152b30d2865]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260]
Oct 26 06:53:01 user nova-compute[74295]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260] successful.
Oct 26 06:53:01 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6a950-8ada-49aa-981d-bbc379191d7b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== disconnect_volume: return (414ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:53:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Deleting instance files /opt/stack/data/nova/instances/89037419-923d-4694-bf39-30f63ae4de16_del
Oct 26 06:53:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Deletion of /opt/stack/data/nova/instances/89037419-923d-4694-bf39-30f63ae4de16_del complete
Oct 26 06:53:01 user nova-compute[74295]: INFO nova.compute.manager [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 26 06:53:01 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:53:01 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 89037419-923d-4694-bf39-30f63ae4de16] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:53:02 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:53:02 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Took 0.77 seconds to deallocate network for instance.
Oct 26 06:53:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-979d87f8-cc54-4a0b-b62a-ac0625556820 req-a0585644-2163-4a6e-9a65-e5a24fc41fab service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received event network-vif-deleted-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:53:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-2447d6ff-8342-45ad-9e93-ed5c904a8a3b req-525cd555-f474-4d88-85a2-13dd9a4641f5 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received event network-vif-plugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:53:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2447d6ff-8342-45ad-9e93-ed5c904a8a3b req-525cd555-f474-4d88-85a2-13dd9a4641f5 service nova] Acquiring lock "89037419-923d-4694-bf39-30f63ae4de16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2447d6ff-8342-45ad-9e93-ed5c904a8a3b req-525cd555-f474-4d88-85a2-13dd9a4641f5 service nova] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2447d6ff-8342-45ad-9e93-ed5c904a8a3b req-525cd555-f474-4d88-85a2-13dd9a4641f5 service nova] Lock "89037419-923d-4694-bf39-30f63ae4de16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:02 user nova-compute[74295]: DEBUG nova.compute.manager [req-2447d6ff-8342-45ad-9e93-ed5c904a8a3b req-525cd555-f474-4d88-85a2-13dd9a4641f5 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] No waiting events found dispatching network-vif-plugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:53:02 user nova-compute[74295]: WARNING nova.compute.manager [req-2447d6ff-8342-45ad-9e93-ed5c904a8a3b req-525cd555-f474-4d88-85a2-13dd9a4641f5 service nova] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Received unexpected event network-vif-plugged-cb61ba87-d0f5-4081-81a5-f55a1efdec30 for instance with vm_state active and task_state deleting.
Oct 26 06:53:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:03 user nova-compute[74295]: INFO nova.compute.manager [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 89037419-923d-4694-bf39-30f63ae4de16] Took 1.01 seconds to detach 1 volumes for instance.
Oct 26 06:53:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:03 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:53:03 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:53:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:03 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Deleted allocations for instance 89037419-923d-4694-bf39-30f63ae4de16
Oct 26 06:53:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-04317172-10b2-43a9-a0a8-f353f4773654 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "89037419-923d-4694-bf39-30f63ae4de16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.477s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:04 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:04 user nova-compute[74295]: INFO nova.compute.manager [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Detaching volume f15de999-635a-4e50-9d7e-c15473b9164a
Oct 26 06:53:04 user nova-compute[74295]: INFO nova.virt.block_device [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attempting to driver detach volume f15de999-635a-4e50-9d7e-c15473b9164a from mountpoint /dev/vdb
Oct 26 06:53:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Attempting to detach device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:53:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:53:04 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:53:04 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:53:04 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:53:04 user nova-compute[74295]:   <serial>f15de999-635a-4e50-9d7e-c15473b9164a</serial>
Oct 26 06:53:04 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:53:04 user nova-compute[74295]: </disk>
Oct 26 06:53:04 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:53:04 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully detached device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the persistent domain config.
Oct 26 06:53:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1a69164-d3a5-4531-a067-161923f10060 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:53:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:53:04 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:53:04 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:53:04 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:53:04 user nova-compute[74295]:   <serial>f15de999-635a-4e50-9d7e-c15473b9164a</serial>
Oct 26 06:53:04 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:53:04 user nova-compute[74295]: </disk>
Oct 26 06:53:04 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:53:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:53:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:23 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:53:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:24 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1a69164-d3a5-4531-a067-161923f10060 is timed out.
Oct 26 06:53:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully detached device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the live domain config.
Oct 26 06:53:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxamrbvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:53:24 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:53:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[44346b78-5132-477b-bb7e-4689ecbd03ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:53:24 user nova-compute[74295]: No targets found.
Oct 26 06:53:24 user nova-compute[74295]: iSNS:
Oct 26 06:53:24 user nova-compute[74295]: No targets found.
Oct 26 06:53:24 user nova-compute[74295]: STATIC:
Oct 26 06:53:24 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a
Oct 26 06:53:24 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:53:24 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:53:24 user nova-compute[74295]: FIRMWARE:
Oct 26 06:53:24 user nova-compute[74295]: No targets found.
Oct 26 06:53:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:53:24 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:53:24 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6d4b1-7135-4c59-a663-84726cf07cce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35ee14b-d4fd-4c6f-be77-575ecb3fee38]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:53:25 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a (non-flash)
Oct 26 06:53:25 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1b81f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a'): ({'sde'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Removing single pathed devices sde {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:25 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:53:25 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8465MB free_disk=25.15093231201172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf2164c-85b8-4dfe-acc7-11719d33e48c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4df28b6-03dc-4db6-bae8-dad3195e60ec]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Flushing IO for device /dev/sde {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb21ebb3-a076-4bfc-ae5b-269dafcc7a8e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[30da8579-8ead-4320-8635-368cb85ab245]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9980fb77-071d-4282-8caf-bd7b6644ad81]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance cfde0bac-90db-40c0-90c6-957b2baf948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 69104a0e-4896-4677-999c-1e5173103e8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac3924b-5747-4701-aaf0-1ff3a8042364]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a, portal: 172.16.0.220,3260]
Oct 26 06:53:25 user nova-compute[74295]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a, portal: 172.16.0.220,3260] successful.
Oct 26 06:53:25 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f15de999-635a-4e50-9d7e-c15473b9164a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[634c8a1d-5346-453e-94b6-811e6901b59f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.619s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== disconnect_volume: return (621ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:53:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:27 user nova-compute[74295]: INFO nova.compute.manager [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Terminating instance
Oct 26 06:53:27 user nova-compute[74295]: DEBUG nova.compute.manager [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-6e9ea432-0f03-484e-9858-d4f08b072f70 req-ab086db7-fcce-43d1-b22a-797795359b6f service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-unplugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6e9ea432-0f03-484e-9858-d4f08b072f70 req-ab086db7-fcce-43d1-b22a-797795359b6f service nova] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6e9ea432-0f03-484e-9858-d4f08b072f70 req-ab086db7-fcce-43d1-b22a-797795359b6f service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6e9ea432-0f03-484e-9858-d4f08b072f70 req-ab086db7-fcce-43d1-b22a-797795359b6f service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-6e9ea432-0f03-484e-9858-d4f08b072f70 req-ab086db7-fcce-43d1-b22a-797795359b6f service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] No waiting events found dispatching network-vif-unplugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-6e9ea432-0f03-484e-9858-d4f08b072f70 req-ab086db7-fcce-43d1-b22a-797795359b6f service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-unplugged-76720f8b-41b5-44f4-b4d3-5f501b977acb for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Instance destroyed successfully.
Oct 26 06:53:28 user nova-compute[74295]: DEBUG nova.objects.instance [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'resources' on Instance uuid cfde0bac-90db-40c0-90c6-957b2baf948c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1987518129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1987518129',id=37,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhL+j1T2jaZDC4siRAiEALDqrNUrSEv5SOAEBUZRHM+o0/6cDlpz+0XtUCGyQJ5Xl0GFgf4wERK7g7yCmcEqhT2OqWWJo1Fwa55ObRVj+BtaPs8U4pJbdlsGqYGYA85qA==',key_name='tempest-keypair-52913859',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:51:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-432f93yk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:51:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=cfde0bac-90db-40c0-90c6-957b2baf948c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "address": "fa:16:3e:cc:64:e5", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76720f8b-41", "ovs_interfaceid": "76720f8b-41b5-44f4-b4d3-5f501b977acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG os_vif [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76720f8b-41, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49ff6fda-ded5-4297-b1e7-a6f463d37af9) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:28 user nova-compute[74295]: INFO os_vif [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:64:e5,bridge_name='br-int',has_traffic_filtering=True,id=76720f8b-41b5-44f4-b4d3-5f501b977acb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76720f8b-41')
Oct 26 06:53:28 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Deleting instance files /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c_del
Oct 26 06:53:28 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Deletion of /opt/stack/data/nova/instances/cfde0bac-90db-40c0-90c6-957b2baf948c_del complete
Oct 26 06:53:28 user nova-compute[74295]: INFO nova.compute.manager [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 26 06:53:28 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:53:28 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG nova.objects.instance [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-5dbf0c59-8bf5-4550-811b-63084c5a923e tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.962s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:53:29 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Took 0.92 seconds to deallocate network for instance.
Oct 26 06:53:29 user nova-compute[74295]: DEBUG nova.compute.manager [req-d439418a-4cc2-4480-bb1e-a30e3e849ce6 req-61e9e103-bac8-42c5-8923-b56b8fb68921 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-deleted-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:53:29 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:53:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:30 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Deleted allocations for instance cfde0bac-90db-40c0-90c6-957b2baf948c
Oct 26 06:53:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-faa3a540-2d49-444e-8586-5f5776d5aab4 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-468df6f1-6729-490e-b82e-e8fb6fd016ea req-9e094935-0b78-4ff0-b8bc-fc4fa48b1962 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:53:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-468df6f1-6729-490e-b82e-e8fb6fd016ea req-9e094935-0b78-4ff0-b8bc-fc4fa48b1962 service nova] Acquiring lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-468df6f1-6729-490e-b82e-e8fb6fd016ea req-9e094935-0b78-4ff0-b8bc-fc4fa48b1962 service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-468df6f1-6729-490e-b82e-e8fb6fd016ea req-9e094935-0b78-4ff0-b8bc-fc4fa48b1962 service nova] Lock "cfde0bac-90db-40c0-90c6-957b2baf948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-468df6f1-6729-490e-b82e-e8fb6fd016ea req-9e094935-0b78-4ff0-b8bc-fc4fa48b1962 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] No waiting events found dispatching network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:53:30 user nova-compute[74295]: WARNING nova.compute.manager [req-468df6f1-6729-490e-b82e-e8fb6fd016ea req-9e094935-0b78-4ff0-b8bc-fc4fa48b1962 service nova] [instance: cfde0bac-90db-40c0-90c6-957b2baf948c] Received unexpected event network-vif-plugged-76720f8b-41b5-44f4-b4d3-5f501b977acb for instance with vm_state deleted and task_state None.
Oct 26 06:53:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:32 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:53:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:53:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:41 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_power_states {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:53:41 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:53:41 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 06:53:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "69104a0e-4896-4677-999c-1e5173103e8b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "69104a0e-4896-4677-999c-1e5173103e8b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:53:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "467bed28-02e4-439d-9b81-75831d638340" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "467bed28-02e4-439d-9b81-75831d638340" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:51 user nova-compute[74295]: DEBUG nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:53:52 user nova-compute[74295]: INFO nova.compute.claims [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Claim successful on node user
Oct 26 06:53:52 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:53:52 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:53:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG nova.policy [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f8c68bbe2245c6b6f159c45e006216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe63ca1f244085963c38b864dff1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:53:52 user nova-compute[74295]: INFO nova.virt.block_device [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Booting with volume c9fcdae4-3465-4086-9bf4-013fc1f2c5be at /dev/vda
Oct 26 06:53:52 user nova-compute[74295]: DEBUG os_brick.utils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e50e76-08c4-4898-9c6e-abeb78f01650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c0a67c-e40a-44a5-9195-3b79e547df35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1662b2f6-111d-48c0-967b-f7449543456b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[306c5e74-3d23-443a-910c-87dedc6d0793]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:53:52 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:53:52 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c9137-b61a-4b68-931c-71d0062cd101]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG os_brick.utils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:53:52 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updating existing volume attachment record: 8afebecc-21ed-44ed-9c1b-efe22fc8feb2 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG nova.network.neutron [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Successfully created port: 88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG nova.network.neutron [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Successfully updated port: 88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquired lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG nova.network.neutron [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-7b857297-cdb7-4cf4-a828-64e6d3cee5fd req-94da5405-bfdc-4238-b43f-de47f20f9160 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received event network-changed-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG nova.compute.manager [req-7b857297-cdb7-4cf4-a828-64e6d3cee5fd req-94da5405-bfdc-4238-b43f-de47f20f9160 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Refreshing instance network info cache due to event network-changed-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7b857297-cdb7-4cf4-a828-64e6d3cee5fd req-94da5405-bfdc-4238-b43f-de47f20f9160 service nova] Acquiring lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:53:53 user nova-compute[74295]: DEBUG nova.network.neutron [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:53:54 user nova-compute[74295]: DEBUG nova.network.neutron [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updating instance_info_cache with network_info: [{"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:53:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Releasing lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:53:54 user nova-compute[74295]: DEBUG nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Instance network_info: |[{"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:53:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7b857297-cdb7-4cf4-a828-64e6d3cee5fd req-94da5405-bfdc-4238-b43f-de47f20f9160 service nova] Acquired lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:53:54 user nova-compute[74295]: DEBUG nova.network.neutron [req-7b857297-cdb7-4cf4-a828-64e6d3cee5fd req-94da5405-bfdc-4238-b43f-de47f20f9160 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Refreshing network info cache for port 88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:53:54 user nova-compute[74295]: DEBUG nova.network.neutron [req-7b857297-cdb7-4cf4-a828-64e6d3cee5fd req-94da5405-bfdc-4238-b43f-de47f20f9160 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updated VIF entry in instance network info cache for port 88f9bc45-5a84-4bf1-bd66-b4d425a49dbc. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:53:54 user nova-compute[74295]: DEBUG nova.network.neutron [req-7b857297-cdb7-4cf4-a828-64e6d3cee5fd req-94da5405-bfdc-4238-b43f-de47f20f9160 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updating instance_info_cache with network_info: [{"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:53:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7b857297-cdb7-4cf4-a828-64e6d3cee5fd req-94da5405-bfdc-4238-b43f-de47f20f9160 service nova] Releasing lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:53:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "022f5750-b856-488f-8312-249885868bff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:53:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:56 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:53:56 user nova-compute[74295]: INFO nova.compute.claims [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Claim successful on node user
Oct 26 06:53:57 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG nova.network.neutron [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:53:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:53:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG nova.policy [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01f2b3710476458abc998271a7047156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43980edd6fd428a94283c56a896d717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:53:57 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Creating image(s)
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "/opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "/opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "/opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.067s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk 1073741824" returned: 0 in 0.066s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG nova.network.neutron [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Successfully created port: e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Cannot resize image /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Ensure instance console log exists: /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:53:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Successfully updated port: e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "refresh_cache-022f5750-b856-488f-8312-249885868bff" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquired lock "refresh_cache-022f5750-b856-488f-8312-249885868bff" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-65d4c3ea-7590-4e2a-a3d5-30b2faaadbb0 req-11f8136f-b960-4c9c-8be8-600c27c2ad72 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received event network-changed-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.compute.manager [req-65d4c3ea-7590-4e2a-a3d5-30b2faaadbb0 req-11f8136f-b960-4c9c-8be8-600c27c2ad72 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Refreshing instance network info cache due to event network-changed-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-65d4c3ea-7590-4e2a-a3d5-30b2faaadbb0 req-11f8136f-b960-4c9c-8be8-600c27c2ad72 service nova] Acquiring lock "refresh_cache-022f5750-b856-488f-8312-249885868bff" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.neutron [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Updating instance_info_cache with network_info: [{"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Releasing lock "refresh_cache-022f5750-b856-488f-8312-249885868bff" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Instance network_info: |[{"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-65d4c3ea-7590-4e2a-a3d5-30b2faaadbb0 req-11f8136f-b960-4c9c-8be8-600c27c2ad72 service nova] Acquired lock "refresh_cache-022f5750-b856-488f-8312-249885868bff" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-65d4c3ea-7590-4e2a-a3d5-30b2faaadbb0 req-11f8136f-b960-4c9c-8be8-600c27c2ad72 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Refreshing network info cache for port e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Start _get_guest_xml network_info=[{"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:53:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:53:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1045752904',display_name='tempest-VolumesSnapshotTestJSON-instance-1045752904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1045752904',id=45,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7krK0l6DU3vA+wBlQV4I/9wyjFBh+yn2HXd5QFR2s7BmMxX06xmUxm5LBj0E9ExxDo0qbCdjs75JkeWjeRQTv/Fc8wZgvXozP0ZZRQqr0C5J+IesdIkKiSuEK3mMLcuA==',key_name='tempest-keypair-1109850942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43980edd6fd428a94283c56a896d717',ramdisk_id='',reservation_id='r-r1y60ojx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1927708355',owner_user_name='tempest-VolumesSnapshotTestJSON-1927708355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01f2b3710476458abc998271a7047156',uuid=022f5750-b856-488f-8312-249885868bff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converting VIF {"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=e2f0a1f7-13fc-455b-96bd-cd0cd5f74885,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0a1f7-13') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.objects.instance [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'pci_devices' on Instance uuid 022f5750-b856-488f-8312-249885868bff {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:53:59 user nova-compute[74295]:   <uuid>022f5750-b856-488f-8312-249885868bff</uuid>
Oct 26 06:53:59 user nova-compute[74295]:   <name>instance-0000002d</name>
Oct 26 06:53:59 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:53:59 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:53:59 user nova-compute[74295]:   <metadata>
Oct 26 06:53:59 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:53:59 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:53:59 user nova-compute[74295]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1045752904</nova:name>
Oct 26 06:53:59 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:53:59</nova:creationTime>
Oct 26 06:53:59 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:53:59 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:53:59 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:53:59 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:53:59 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:53:59 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:53:59 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:53:59 user nova-compute[74295]:       <nova:owner>
Oct 26 06:53:59 user nova-compute[74295]:         <nova:user uuid="01f2b3710476458abc998271a7047156">tempest-VolumesSnapshotTestJSON-1927708355-project-member</nova:user>
Oct 26 06:53:59 user nova-compute[74295]:         <nova:project uuid="b43980edd6fd428a94283c56a896d717">tempest-VolumesSnapshotTestJSON-1927708355</nova:project>
Oct 26 06:53:59 user nova-compute[74295]:       </nova:owner>
Oct 26 06:53:59 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:53:59 user nova-compute[74295]:       <nova:ports>
Oct 26 06:53:59 user nova-compute[74295]:         <nova:port uuid="e2f0a1f7-13fc-455b-96bd-cd0cd5f74885">
Oct 26 06:53:59 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 06:53:59 user nova-compute[74295]:         </nova:port>
Oct 26 06:53:59 user nova-compute[74295]:       </nova:ports>
Oct 26 06:53:59 user nova-compute[74295]:     </nova:instance>
Oct 26 06:53:59 user nova-compute[74295]:   </metadata>
Oct 26 06:53:59 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:53:59 user nova-compute[74295]:     <system>
Oct 26 06:53:59 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:53:59 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:53:59 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:53:59 user nova-compute[74295]:       <entry name="serial">022f5750-b856-488f-8312-249885868bff</entry>
Oct 26 06:53:59 user nova-compute[74295]:       <entry name="uuid">022f5750-b856-488f-8312-249885868bff</entry>
Oct 26 06:53:59 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:53:59 user nova-compute[74295]:     </system>
Oct 26 06:53:59 user nova-compute[74295]:   </sysinfo>
Oct 26 06:53:59 user nova-compute[74295]:   <os>
Oct 26 06:53:59 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:53:59 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:53:59 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:53:59 user nova-compute[74295]:   </os>
Oct 26 06:53:59 user nova-compute[74295]:   <features>
Oct 26 06:53:59 user nova-compute[74295]:     <acpi/>
Oct 26 06:53:59 user nova-compute[74295]:     <apic/>
Oct 26 06:53:59 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:53:59 user nova-compute[74295]:   </features>
Oct 26 06:53:59 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:53:59 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:53:59 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:53:59 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:53:59 user nova-compute[74295]:   </clock>
Oct 26 06:53:59 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:53:59 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:53:59 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:53:59 user nova-compute[74295]:   </cpu>
Oct 26 06:53:59 user nova-compute[74295]:   <devices>
Oct 26 06:53:59 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:53:59 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:53:59 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk"/>
Oct 26 06:53:59 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:53:59 user nova-compute[74295]:     </disk>
Oct 26 06:53:59 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:53:59 user nova-compute[74295]:       <mac address="fa:16:3e:d3:30:e5"/>
Oct 26 06:53:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:53:59 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:53:59 user nova-compute[74295]:       <target dev="tape2f0a1f7-13"/>
Oct 26 06:53:59 user nova-compute[74295]:     </interface>
Oct 26 06:53:59 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:53:59 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/console.log" append="off"/>
Oct 26 06:53:59 user nova-compute[74295]:     </serial>
Oct 26 06:53:59 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:53:59 user nova-compute[74295]:     <video>
Oct 26 06:53:59 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:53:59 user nova-compute[74295]:     </video>
Oct 26 06:53:59 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:53:59 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:53:59 user nova-compute[74295]:     </rng>
Oct 26 06:53:59 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:53:59 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:53:59 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:53:59 user nova-compute[74295]:     </memballoon>
Oct 26 06:53:59 user nova-compute[74295]:   </devices>
Oct 26 06:53:59 user nova-compute[74295]: </domain>
Oct 26 06:53:59 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1045752904',display_name='tempest-VolumesSnapshotTestJSON-instance-1045752904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1045752904',id=45,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7krK0l6DU3vA+wBlQV4I/9wyjFBh+yn2HXd5QFR2s7BmMxX06xmUxm5LBj0E9ExxDo0qbCdjs75JkeWjeRQTv/Fc8wZgvXozP0ZZRQqr0C5J+IesdIkKiSuEK3mMLcuA==',key_name='tempest-keypair-1109850942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43980edd6fd428a94283c56a896d717',ramdisk_id='',reservation_id='r-r1y60ojx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1927708355',owner_user_name='tempest-VolumesSnapshotTestJSON-1927708355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01f2b3710476458abc998271a7047156',uuid=022f5750-b856-488f-8312-249885868bff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converting VIF {"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=e2f0a1f7-13fc-455b-96bd-cd0cd5f74885,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0a1f7-13') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG os_vif [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=e2f0a1f7-13fc-455b-96bd-cd0cd5f74885,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0a1f7-13') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b48118b-0ce5-583c-bfbd-f3494637b52d', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2f0a1f7-13, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2f0a1f7-13, col_values=(('qos', UUID('566181a9-9d12-4da6-8dc9-4e5d80c0e694')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2f0a1f7-13, col_values=(('external_ids', {'iface-id': 'e2f0a1f7-13fc-455b-96bd-cd0cd5f74885', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:30:e5', 'vm-uuid': '022f5750-b856-488f-8312-249885868bff'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:53:59 user nova-compute[74295]: INFO os_vif [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=e2f0a1f7-13fc-455b-96bd-cd0cd5f74885,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0a1f7-13')
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No VIF found with MAC fa:16:3e:d3:30:e5, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-65d4c3ea-7590-4e2a-a3d5-30b2faaadbb0 req-11f8136f-b960-4c9c-8be8-600c27c2ad72 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Updated VIF entry in instance network info cache for port e2f0a1f7-13fc-455b-96bd-cd0cd5f74885. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG nova.network.neutron [req-65d4c3ea-7590-4e2a-a3d5-30b2faaadbb0 req-11f8136f-b960-4c9c-8be8-600c27c2ad72 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Updating instance_info_cache with network_info: [{"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:53:59 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-65d4c3ea-7590-4e2a-a3d5-30b2faaadbb0 req-11f8136f-b960-4c9c-8be8-600c27c2ad72 service nova] Releasing lock "refresh_cache-022f5750-b856-488f-8312-249885868bff" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:54:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:54:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:00 user nova-compute[74295]: INFO nova.compute.manager [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attaching volume 48a3453c-0077-4569-8c4d-77602e0956bc to /dev/vdb
Oct 26 06:54:01 user nova-compute[74295]: DEBUG os_brick.utils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab160fa-b8ed-4304-8a37-5d13dfa8e565]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd3bd96-35b4-4f22-9c99-f98253d9cd26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a7d080-ef58-41ba-b6c9-35349c996e35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[51850608-8b1e-4775-a64f-d9df50cc8954]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-43296c6b-1e30-4042-b768-1d36b7ad5278 req-f1361806-520f-4ff3-84da-fd4e6bd16556 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received event network-vif-plugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-43296c6b-1e30-4042-b768-1d36b7ad5278 req-f1361806-520f-4ff3-84da-fd4e6bd16556 service nova] Acquiring lock "022f5750-b856-488f-8312-249885868bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-43296c6b-1e30-4042-b768-1d36b7ad5278 req-f1361806-520f-4ff3-84da-fd4e6bd16556 service nova] Lock "022f5750-b856-488f-8312-249885868bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-43296c6b-1e30-4042-b768-1d36b7ad5278 req-f1361806-520f-4ff3-84da-fd4e6bd16556 service nova] Lock "022f5750-b856-488f-8312-249885868bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG nova.compute.manager [req-43296c6b-1e30-4042-b768-1d36b7ad5278 req-f1361806-520f-4ff3-84da-fd4e6bd16556 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] No waiting events found dispatching network-vif-plugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:54:01 user nova-compute[74295]: WARNING nova.compute.manager [req-43296c6b-1e30-4042-b768-1d36b7ad5278 req-f1361806-520f-4ff3-84da-fd4e6bd16556 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received unexpected event network-vif-plugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 for instance with vm_state building and task_state spawning.
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:54:01 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:54:01 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f677d3b-7b8a-47c0-981a-803fec6ca0c9]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG os_brick.utils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating existing volume attachment record: 803d58d1-e508-4ea7-902c-883472c900d7 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:54:03 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 022f5750-b856-488f-8312-249885868bff] Instance spawned successfully.
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:03 user nova-compute[74295]: INFO nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Took 5.61 seconds to spawn the instance on the hypervisor.
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-cce708b0-07f1-4bf9-8a83-6910489d205f req-7d573090-f645-41c1-a396-4e34314c4b62 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received event network-vif-plugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cce708b0-07f1-4bf9-8a83-6910489d205f req-7d573090-f645-41c1-a396-4e34314c4b62 service nova] Acquiring lock "022f5750-b856-488f-8312-249885868bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cce708b0-07f1-4bf9-8a83-6910489d205f req-7d573090-f645-41c1-a396-4e34314c4b62 service nova] Lock "022f5750-b856-488f-8312-249885868bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cce708b0-07f1-4bf9-8a83-6910489d205f req-7d573090-f645-41c1-a396-4e34314c4b62 service nova] Lock "022f5750-b856-488f-8312-249885868bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-cce708b0-07f1-4bf9-8a83-6910489d205f req-7d573090-f645-41c1-a396-4e34314c4b62 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] No waiting events found dispatching network-vif-plugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:54:03 user nova-compute[74295]: WARNING nova.compute.manager [req-cce708b0-07f1-4bf9-8a83-6910489d205f req-7d573090-f645-41c1-a396-4e34314c4b62 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received unexpected event network-vif-plugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 for instance with vm_state building and task_state spawning.
Oct 26 06:54:03 user nova-compute[74295]: INFO nova.compute.manager [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Took 6.33 seconds to build instance.
Oct 26 06:54:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-efb551b0-48ef-47cf-9e44-37270dfc012c tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.430s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:54:11 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Creating image(s)
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Ensure instance console log exists: /opt/stack/data/nova/instances/467bed28-02e4-439d-9b81-75831d638340/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Start _get_guest_xml network_info=[{"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8afebecc-21ed-44ed-9c1b-efe22fc8feb2', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSYcHXpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '467bed28-02e4-439d-9b81-75831d638340', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'serial': 'c9fcdae4-3465-4086-9bf4-013fc1f2c5be'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:54:11 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:54:11 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSYcHXpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:54:11 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:54:11 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:54:11 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b344da2-f395-4ea0-b29e-cacffefbfe15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:54:11 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b48981-fdcf-4347-9be6-e8ea8792f77d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be] added
Oct 26 06:54:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c50c13c-a96c-4f7e-bc83-96e069a2822b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3afabe-e36b-41d9-b5b5-e602781f08b3]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSYcHXpa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSYcHXpa" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46764a4-8d9c-45c2-8ade-47c34637a8ad]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WSYcHXpa'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58de71f-c805-4c57-b628-802ec752aa6f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcb5907-8616-4aee-949a-fd21a0d09dba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 06:54:11 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 06:54:11 user nova-compute[74295]:  {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:54:11 user nova-compute[74295]: WARNING os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 06:54:11 user nova-compute[74295]: 
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf639c13-4a35-4a26-b218-dc8ff85a5764]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260]
Oct 26 06:54:11 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260] successful.
Oct 26 06:54:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c0b89f-e909-40ba-a531-49a0edf38891]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[32776d7d-f17d-4858-aeb6-44759bba2f38]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:54:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:54:11 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d107d-0e2b-46b6-9966-5a46c0e8e3b3]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:54:11 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSYcHXpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23766363162356565', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766363162356565', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-278082241',display_name='tempest-TestVolumeBootPattern-server-278082241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-278082241',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO37LOfLGVLm8denc0aiOr8WCYx77Qraf7D47fN50S5LIaTBdJywjgiKJrg/08AIIVYLPW9NSG8sjHJOCwCiCGyrZMujB/2p5ls6F3JGSk5q17MYb1TgqAWMzwRKoYJlRg==',key_name='tempest-TestVolumeBootPattern-373663211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-w9bq0b0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:53:52Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=467bed28-02e4-439d-9b81-75831d638340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:bd:91,bridge_name='br-int',has_traffic_filtering=True,id=88f9bc45-5a84-4bf1-bd66-b4d425a49dbc,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f9bc45-5a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.objects.instance [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'pci_devices' on Instance uuid 467bed28-02e4-439d-9b81-75831d638340 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:54:12 user nova-compute[74295]:   <uuid>467bed28-02e4-439d-9b81-75831d638340</uuid>
Oct 26 06:54:12 user nova-compute[74295]:   <name>instance-0000002c</name>
Oct 26 06:54:12 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:54:12 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:54:12 user nova-compute[74295]:   <metadata>
Oct 26 06:54:12 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:54:12 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:54:12 user nova-compute[74295]:       <nova:name>tempest-TestVolumeBootPattern-server-278082241</nova:name>
Oct 26 06:54:12 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:54:11</nova:creationTime>
Oct 26 06:54:12 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:54:12 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:54:12 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:54:12 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:54:12 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:54:12 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:54:12 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:54:12 user nova-compute[74295]:       <nova:owner>
Oct 26 06:54:12 user nova-compute[74295]:         <nova:user uuid="11f8c68bbe2245c6b6f159c45e006216">tempest-TestVolumeBootPattern-594294549-project-member</nova:user>
Oct 26 06:54:12 user nova-compute[74295]:         <nova:project uuid="75fe63ca1f244085963c38b864dff1db">tempest-TestVolumeBootPattern-594294549</nova:project>
Oct 26 06:54:12 user nova-compute[74295]:       </nova:owner>
Oct 26 06:54:12 user nova-compute[74295]:       <nova:ports>
Oct 26 06:54:12 user nova-compute[74295]:         <nova:port uuid="88f9bc45-5a84-4bf1-bd66-b4d425a49dbc">
Oct 26 06:54:12 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 06:54:12 user nova-compute[74295]:         </nova:port>
Oct 26 06:54:12 user nova-compute[74295]:       </nova:ports>
Oct 26 06:54:12 user nova-compute[74295]:     </nova:instance>
Oct 26 06:54:12 user nova-compute[74295]:   </metadata>
Oct 26 06:54:12 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:54:12 user nova-compute[74295]:     <system>
Oct 26 06:54:12 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:54:12 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:54:12 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:54:12 user nova-compute[74295]:       <entry name="serial">467bed28-02e4-439d-9b81-75831d638340</entry>
Oct 26 06:54:12 user nova-compute[74295]:       <entry name="uuid">467bed28-02e4-439d-9b81-75831d638340</entry>
Oct 26 06:54:12 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:54:12 user nova-compute[74295]:     </system>
Oct 26 06:54:12 user nova-compute[74295]:   </sysinfo>
Oct 26 06:54:12 user nova-compute[74295]:   <os>
Oct 26 06:54:12 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:54:12 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:54:12 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:54:12 user nova-compute[74295]:   </os>
Oct 26 06:54:12 user nova-compute[74295]:   <features>
Oct 26 06:54:12 user nova-compute[74295]:     <acpi/>
Oct 26 06:54:12 user nova-compute[74295]:     <apic/>
Oct 26 06:54:12 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:54:12 user nova-compute[74295]:   </features>
Oct 26 06:54:12 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:54:12 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:54:12 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:54:12 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:54:12 user nova-compute[74295]:   </clock>
Oct 26 06:54:12 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:54:12 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:54:12 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:54:12 user nova-compute[74295]:   </cpu>
Oct 26 06:54:12 user nova-compute[74295]:   <devices>
Oct 26 06:54:12 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:54:12 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:54:12 user nova-compute[74295]:       <source dev="/dev/sdb"/>
Oct 26 06:54:12 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:54:12 user nova-compute[74295]:       <serial>c9fcdae4-3465-4086-9bf4-013fc1f2c5be</serial>
Oct 26 06:54:12 user nova-compute[74295]:     </disk>
Oct 26 06:54:12 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:54:12 user nova-compute[74295]:       <mac address="fa:16:3e:91:bd:91"/>
Oct 26 06:54:12 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:54:12 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:54:12 user nova-compute[74295]:       <target dev="tap88f9bc45-5a"/>
Oct 26 06:54:12 user nova-compute[74295]:     </interface>
Oct 26 06:54:12 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:54:12 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/467bed28-02e4-439d-9b81-75831d638340/console.log" append="off"/>
Oct 26 06:54:12 user nova-compute[74295]:     </serial>
Oct 26 06:54:12 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:54:12 user nova-compute[74295]:     <video>
Oct 26 06:54:12 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:54:12 user nova-compute[74295]:     </video>
Oct 26 06:54:12 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:54:12 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:54:12 user nova-compute[74295]:     </rng>
Oct 26 06:54:12 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:54:12 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:54:12 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:54:12 user nova-compute[74295]:     </memballoon>
Oct 26 06:54:12 user nova-compute[74295]:   </devices>
Oct 26 06:54:12 user nova-compute[74295]: </domain>
Oct 26 06:54:12 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-278082241',display_name='tempest-TestVolumeBootPattern-server-278082241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-278082241',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO37LOfLGVLm8denc0aiOr8WCYx77Qraf7D47fN50S5LIaTBdJywjgiKJrg/08AIIVYLPW9NSG8sjHJOCwCiCGyrZMujB/2p5ls6F3JGSk5q17MYb1TgqAWMzwRKoYJlRg==',key_name='tempest-TestVolumeBootPattern-373663211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-w9bq0b0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:53:52Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=467bed28-02e4-439d-9b81-75831d638340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:bd:91,bridge_name='br-int',has_traffic_filtering=True,id=88f9bc45-5a84-4bf1-bd66-b4d425a49dbc,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f9bc45-5a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG os_vif [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:bd:91,bridge_name='br-int',has_traffic_filtering=True,id=88f9bc45-5a84-4bf1-bd66-b4d425a49dbc,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f9bc45-5a') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c690b8c1-2017-500c-a1b8-f62b7a00d2f5', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88f9bc45-5a, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88f9bc45-5a, col_values=(('qos', UUID('ba70ae8b-6495-45f4-b3bb-9cde7e3e0321')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88f9bc45-5a, col_values=(('external_ids', {'iface-id': '88f9bc45-5a84-4bf1-bd66-b4d425a49dbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:bd:91', 'vm-uuid': '467bed28-02e4-439d-9b81-75831d638340'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:12 user nova-compute[74295]: INFO os_vif [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:bd:91,bridge_name='br-int',has_traffic_filtering=True,id=88f9bc45-5a84-4bf1-bd66-b4d425a49dbc,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f9bc45-5a')
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:54:12 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No VIF found with MAC fa:16:3e:91:bd:91, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:54:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-14dd3350-d866-4bde-b302-7fe809ceac35 req-c63f7de7-d7c6-4637-a063-807317e64862 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received event network-vif-plugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:54:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-14dd3350-d866-4bde-b302-7fe809ceac35 req-c63f7de7-d7c6-4637-a063-807317e64862 service nova] Acquiring lock "467bed28-02e4-439d-9b81-75831d638340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-14dd3350-d866-4bde-b302-7fe809ceac35 req-c63f7de7-d7c6-4637-a063-807317e64862 service nova] Lock "467bed28-02e4-439d-9b81-75831d638340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-14dd3350-d866-4bde-b302-7fe809ceac35 req-c63f7de7-d7c6-4637-a063-807317e64862 service nova] Lock "467bed28-02e4-439d-9b81-75831d638340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-14dd3350-d866-4bde-b302-7fe809ceac35 req-c63f7de7-d7c6-4637-a063-807317e64862 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] No waiting events found dispatching network-vif-plugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:54:14 user nova-compute[74295]: WARNING nova.compute.manager [req-14dd3350-d866-4bde-b302-7fe809ceac35 req-c63f7de7-d7c6-4637-a063-807317e64862 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received unexpected event network-vif-plugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc for instance with vm_state building and task_state spawning.
Oct 26 06:54:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:54:16 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 467bed28-02e4-439d-9b81-75831d638340] Instance spawned successfully.
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:16 user nova-compute[74295]: INFO nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Took 5.19 seconds to spawn the instance on the hypervisor.
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:54:16 user nova-compute[74295]: INFO nova.compute.manager [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Took 24.32 seconds to build instance.
Oct 26 06:54:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-45797155-a3c0-4874-b32d-0598227ba8f4 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "467bed28-02e4-439d-9b81-75831d638340" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.423s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-6011fe19-d41c-4b40-b404-aea5b778b803 req-27e8d3f9-88c1-42db-b2b8-c6c47eb2cefc service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received event network-vif-plugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6011fe19-d41c-4b40-b404-aea5b778b803 req-27e8d3f9-88c1-42db-b2b8-c6c47eb2cefc service nova] Acquiring lock "467bed28-02e4-439d-9b81-75831d638340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6011fe19-d41c-4b40-b404-aea5b778b803 req-27e8d3f9-88c1-42db-b2b8-c6c47eb2cefc service nova] Lock "467bed28-02e4-439d-9b81-75831d638340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6011fe19-d41c-4b40-b404-aea5b778b803 req-27e8d3f9-88c1-42db-b2b8-c6c47eb2cefc service nova] Lock "467bed28-02e4-439d-9b81-75831d638340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-6011fe19-d41c-4b40-b404-aea5b778b803 req-27e8d3f9-88c1-42db-b2b8-c6c47eb2cefc service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] No waiting events found dispatching network-vif-plugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:54:16 user nova-compute[74295]: WARNING nova.compute.manager [req-6011fe19-d41c-4b40-b404-aea5b778b803 req-27e8d3f9-88c1-42db-b2b8-c6c47eb2cefc service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received unexpected event network-vif-plugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc for instance with vm_state active and task_state None.
Oct 26 06:54:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZOfzATn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:54:20 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:54:20 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:54:20 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[26095fa7-00ea-42f9-993e-4c3fdc8c3163]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:54:20 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fc4803-c4a0-4744-a98d-511810310885]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc] added
Oct 26 06:54:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[be24bcd4-be01-4dfa-a292-80f3ff09173c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d51c49-91d2-45a8-8cf2-96043b569058]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZOfzATn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZOfzATn" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae580a8-ee69-47fd-a10d-a53d791439e1]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SZOfzATn'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adc4bfa-93b1-4d2a-8125-d801187dc0c1]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f14cbd1-73ce-4f52-abae-09f4e49f0de4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:54:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:54:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9e8b52-fc36-49f6-9526-6b73d8d88761]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc, portal: 172.16.0.220,3260]
Oct 26 06:54:20 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc, portal: 172.16.0.220,3260] successful.
Oct 26 06:54:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ec885d-cbfd-43e1-aa77-c44e6739449f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb2bf2-afb2-4f8d-9504-5bfa49b2a7e2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:54:20 user nova-compute[74295]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc (non-flash)
Oct 26 06:54:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:54:20 user nova-compute[74295]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc (non-flash)
Oct 26 06:54:20 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c93146-1e56-4ccc-bfb6-4894f7608990]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:54:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZOfzATn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23731303634656436', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731303634656436', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:54:21 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:54:21 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:54:21 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:54:21 user nova-compute[74295]:   <serial>48a3453c-0077-4569-8c4d-77602e0956bc</serial>
Oct 26 06:54:21 user nova-compute[74295]: </disk>
Oct 26 06:54:21 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:21 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:54:21 user nova-compute[74295]: INFO nova.compute.claims [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Claim successful on node user
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No VIF found with MAC fa:16:3e:dd:27:97, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.network.neutron [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:54:22 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.policy [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ce2ec6aad1e4e068958bcc61d50cb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a74a5d314a4075923b5c21b2c39097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c8915f45-8016-4419-b20b-3df20ea317c2 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.362s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:54:22 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Creating image(s)
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.192s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk 1073741824" returned: 0 in 0.060s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:22 user nova-compute[74295]: DEBUG nova.network.neutron [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Successfully created port: eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Cannot resize image /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Ensure instance console log exists: /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG nova.network.neutron [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Successfully updated port: eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquired lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG nova.network.neutron [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG nova.compute.manager [req-01a82bd4-6215-493e-a81c-affc9d612561 req-c3421535-7741-45e9-a3c3-3b593ca34e4c service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-changed-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG nova.compute.manager [req-01a82bd4-6215-493e-a81c-affc9d612561 req-c3421535-7741-45e9-a3c3-3b593ca34e4c service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Refreshing instance network info cache due to event network-changed-eec1cce7-3079-4a81-80a5-019a4f7fa7eb. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-01a82bd4-6215-493e-a81c-affc9d612561 req-c3421535-7741-45e9-a3c3-3b593ca34e4c service nova] Acquiring lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:54:23 user nova-compute[74295]: DEBUG nova.network.neutron [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.network.neutron [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating instance_info_cache with network_info: [{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Releasing lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance network_info: |[{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-01a82bd4-6215-493e-a81c-affc9d612561 req-c3421535-7741-45e9-a3c3-3b593ca34e4c service nova] Acquired lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.network.neutron [req-01a82bd4-6215-493e-a81c-affc9d612561 req-c3421535-7741-45e9-a3c3-3b593ca34e4c service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Refreshing network info cache for port eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Start _get_guest_xml network_info=[{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:24 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:54:24 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:54:24 user nova-compute[74295]: INFO nova.compute.manager [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Detaching volume 48a3453c-0077-4569-8c4d-77602e0956bc
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1628253072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1628253072',id=46,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBHdg/Ng2JnVD3A+ZVC2yiJGHaG39oVppuiWnjfhemy4nwp0brDK+xBtnuqoM8+q4/fWy4ldBf8vD3rmVGELnr4tgj51nJ9TinQJUiTWxJMFKlM7clTV1tMHTQ9fgreOg==',key_name='tempest-keypair-1359324483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-1540cl09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:54:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=5749e61b-a89c-4279-93db-56586f314c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.objects.instance [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'pci_devices' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:54:24 user nova-compute[74295]:   <uuid>5749e61b-a89c-4279-93db-56586f314c4c</uuid>
Oct 26 06:54:24 user nova-compute[74295]:   <name>instance-0000002e</name>
Oct 26 06:54:24 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:54:24 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:54:24 user nova-compute[74295]:   <metadata>
Oct 26 06:54:24 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:54:24 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:54:24 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1628253072</nova:name>
Oct 26 06:54:24 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:54:24</nova:creationTime>
Oct 26 06:54:24 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:54:24 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:54:24 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:54:24 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:54:24 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:54:24 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:54:24 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:54:24 user nova-compute[74295]:       <nova:owner>
Oct 26 06:54:24 user nova-compute[74295]:         <nova:user uuid="8ce2ec6aad1e4e068958bcc61d50cb73">tempest-AttachVolumeShelveTestJSON-1252316399-project-member</nova:user>
Oct 26 06:54:24 user nova-compute[74295]:         <nova:project uuid="74a74a5d314a4075923b5c21b2c39097">tempest-AttachVolumeShelveTestJSON-1252316399</nova:project>
Oct 26 06:54:24 user nova-compute[74295]:       </nova:owner>
Oct 26 06:54:24 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:54:24 user nova-compute[74295]:       <nova:ports>
Oct 26 06:54:24 user nova-compute[74295]:         <nova:port uuid="eec1cce7-3079-4a81-80a5-019a4f7fa7eb">
Oct 26 06:54:24 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 06:54:24 user nova-compute[74295]:         </nova:port>
Oct 26 06:54:24 user nova-compute[74295]:       </nova:ports>
Oct 26 06:54:24 user nova-compute[74295]:     </nova:instance>
Oct 26 06:54:24 user nova-compute[74295]:   </metadata>
Oct 26 06:54:24 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:54:24 user nova-compute[74295]:     <system>
Oct 26 06:54:24 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:54:24 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:54:24 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:54:24 user nova-compute[74295]:       <entry name="serial">5749e61b-a89c-4279-93db-56586f314c4c</entry>
Oct 26 06:54:24 user nova-compute[74295]:       <entry name="uuid">5749e61b-a89c-4279-93db-56586f314c4c</entry>
Oct 26 06:54:24 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:54:24 user nova-compute[74295]:     </system>
Oct 26 06:54:24 user nova-compute[74295]:   </sysinfo>
Oct 26 06:54:24 user nova-compute[74295]:   <os>
Oct 26 06:54:24 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:54:24 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:54:24 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:54:24 user nova-compute[74295]:   </os>
Oct 26 06:54:24 user nova-compute[74295]:   <features>
Oct 26 06:54:24 user nova-compute[74295]:     <acpi/>
Oct 26 06:54:24 user nova-compute[74295]:     <apic/>
Oct 26 06:54:24 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:54:24 user nova-compute[74295]:   </features>
Oct 26 06:54:24 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:54:24 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:54:24 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:54:24 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:54:24 user nova-compute[74295]:   </clock>
Oct 26 06:54:24 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:54:24 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:54:24 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:54:24 user nova-compute[74295]:   </cpu>
Oct 26 06:54:24 user nova-compute[74295]:   <devices>
Oct 26 06:54:24 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:54:24 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:54:24 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk"/>
Oct 26 06:54:24 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:54:24 user nova-compute[74295]:     </disk>
Oct 26 06:54:24 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:54:24 user nova-compute[74295]:       <mac address="fa:16:3e:87:d8:08"/>
Oct 26 06:54:24 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:54:24 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:54:24 user nova-compute[74295]:       <target dev="tapeec1cce7-30"/>
Oct 26 06:54:24 user nova-compute[74295]:     </interface>
Oct 26 06:54:24 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:54:24 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/console.log" append="off"/>
Oct 26 06:54:24 user nova-compute[74295]:     </serial>
Oct 26 06:54:24 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:54:24 user nova-compute[74295]:     <video>
Oct 26 06:54:24 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:54:24 user nova-compute[74295]:     </video>
Oct 26 06:54:24 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:54:24 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:54:24 user nova-compute[74295]:     </rng>
Oct 26 06:54:24 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:54:24 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:54:24 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:54:24 user nova-compute[74295]:     </memballoon>
Oct 26 06:54:24 user nova-compute[74295]:   </devices>
Oct 26 06:54:24 user nova-compute[74295]: </domain>
Oct 26 06:54:24 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1628253072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1628253072',id=46,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBHdg/Ng2JnVD3A+ZVC2yiJGHaG39oVppuiWnjfhemy4nwp0brDK+xBtnuqoM8+q4/fWy4ldBf8vD3rmVGELnr4tgj51nJ9TinQJUiTWxJMFKlM7clTV1tMHTQ9fgreOg==',key_name='tempest-keypair-1359324483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-1540cl09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:54:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=5749e61b-a89c-4279-93db-56586f314c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG os_vif [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de1d1d40-2217-5c61-b4d3-616818b317d6', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeec1cce7-30, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeec1cce7-30, col_values=(('qos', UUID('5ecfac5e-0390-48a9-bdd1-424ec89a60e9')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeec1cce7-30, col_values=(('external_ids', {'iface-id': 'eec1cce7-3079-4a81-80a5-019a4f7fa7eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:d8:08', 'vm-uuid': '5749e61b-a89c-4279-93db-56586f314c4c'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:24 user nova-compute[74295]: INFO os_vif [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30')
Oct 26 06:54:24 user nova-compute[74295]: INFO nova.virt.block_device [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attempting to driver detach volume 48a3453c-0077-4569-8c4d-77602e0956bc from mountpoint /dev/vdb
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Attempting to detach device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:54:24 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:54:24 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:54:24 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:54:24 user nova-compute[74295]:   <serial>48a3453c-0077-4569-8c4d-77602e0956bc</serial>
Oct 26 06:54:24 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:54:24 user nova-compute[74295]: </disk>
Oct 26 06:54:24 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:54:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully detached device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the persistent domain config.
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1a69164-d3a5-4531-a067-161923f10060 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:54:24 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:54:24 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:54:24 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:54:24 user nova-compute[74295]:   <serial>48a3453c-0077-4569-8c4d-77602e0956bc</serial>
Oct 26 06:54:24 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:54:24 user nova-compute[74295]: </disk>
Oct 26 06:54:24 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] No VIF found with MAC fa:16:3e:87:d8:08, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.network.neutron [req-01a82bd4-6215-493e-a81c-affc9d612561 req-c3421535-7741-45e9-a3c3-3b593ca34e4c service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updated VIF entry in instance network info cache for port eec1cce7-3079-4a81-80a5-019a4f7fa7eb. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG nova.network.neutron [req-01a82bd4-6215-493e-a81c-affc9d612561 req-c3421535-7741-45e9-a3c3-3b593ca34e4c service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating instance_info_cache with network_info: [{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:54:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-01a82bd4-6215-493e-a81c-affc9d612561 req-c3421535-7741-45e9-a3c3-3b593ca34e4c service nova] Releasing lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:54:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:54:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:25 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-00221fef-0574-4610-a25e-4f80810a3a1c req-fae0f667-49ae-4002-a5dc-6dc79c6dc5fe service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-00221fef-0574-4610-a25e-4f80810a3a1c req-fae0f667-49ae-4002-a5dc-6dc79c6dc5fe service nova] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-00221fef-0574-4610-a25e-4f80810a3a1c req-fae0f667-49ae-4002-a5dc-6dc79c6dc5fe service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-00221fef-0574-4610-a25e-4f80810a3a1c req-fae0f667-49ae-4002-a5dc-6dc79c6dc5fe service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-00221fef-0574-4610-a25e-4f80810a3a1c req-fae0f667-49ae-4002-a5dc-6dc79c6dc5fe service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] No waiting events found dispatching network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:54:26 user nova-compute[74295]: WARNING nova.compute.manager [req-00221fef-0574-4610-a25e-4f80810a3a1c req-fae0f667-49ae-4002-a5dc-6dc79c6dc5fe service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received unexpected event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb for instance with vm_state building and task_state spawning.
Oct 26 06:54:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-a82be6ba-6014-483a-a4da-f9c380ce753b req-fe39aa66-f72a-4c19-a2dc-4852c8b6467b service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a82be6ba-6014-483a-a4da-f9c380ce753b req-fe39aa66-f72a-4c19-a2dc-4852c8b6467b service nova] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a82be6ba-6014-483a-a4da-f9c380ce753b req-fe39aa66-f72a-4c19-a2dc-4852c8b6467b service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a82be6ba-6014-483a-a4da-f9c380ce753b req-fe39aa66-f72a-4c19-a2dc-4852c8b6467b service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-a82be6ba-6014-483a-a4da-f9c380ce753b req-fe39aa66-f72a-4c19-a2dc-4852c8b6467b service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] No waiting events found dispatching network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:54:28 user nova-compute[74295]: WARNING nova.compute.manager [req-a82be6ba-6014-483a-a4da-f9c380ce753b req-fe39aa66-f72a-4c19-a2dc-4852c8b6467b service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received unexpected event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb for instance with vm_state building and task_state spawning.
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:54:28 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance spawned successfully.
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:54:28 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:54:28 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8253MB free_disk=25.146331787109375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:54:28 user nova-compute[74295]: INFO nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Took 6.51 seconds to spawn the instance on the hypervisor.
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 69104a0e-4896-4677-999c-1e5173103e8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 467bed28-02e4-439d-9b81-75831d638340 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 022f5750-b856-488f-8312-249885868bff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 5749e61b-a89c-4279-93db-56586f314c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:54:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:54:29 user nova-compute[74295]: INFO nova.compute.manager [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Took 7.22 seconds to build instance.
Oct 26 06:54:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-36641934-02d3-47ce-b21c-cf266c09241a tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.332s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:29 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:54:29 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:54:29 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:54:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:30 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:54:32 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:54:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:54:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:54:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:54:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: a1a69164-d3a5-4531-a067-161923f10060] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:54:33 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:54:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating instance_info_cache with network_info: [{"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:54:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:54:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:54:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-3515e6c8-540e-40f4-8a9f-e5082587cf7f req-b6d6d0a4-f8f0-4fd6-a092-1377ea6d23db service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received event network-changed-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:54:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-3515e6c8-540e-40f4-8a9f-e5082587cf7f req-b6d6d0a4-f8f0-4fd6-a092-1377ea6d23db service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Refreshing instance network info cache due to event network-changed-a3411818-f27e-4611-bd69-b00b67614770. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:54:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3515e6c8-540e-40f4-8a9f-e5082587cf7f req-b6d6d0a4-f8f0-4fd6-a092-1377ea6d23db service nova] Acquiring lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:54:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3515e6c8-540e-40f4-8a9f-e5082587cf7f req-b6d6d0a4-f8f0-4fd6-a092-1377ea6d23db service nova] Acquired lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:54:36 user nova-compute[74295]: DEBUG nova.network.neutron [req-3515e6c8-540e-40f4-8a9f-e5082587cf7f req-b6d6d0a4-f8f0-4fd6-a092-1377ea6d23db service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Refreshing network info cache for port a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:54:36 user nova-compute[74295]: DEBUG nova.network.neutron [req-3515e6c8-540e-40f4-8a9f-e5082587cf7f req-b6d6d0a4-f8f0-4fd6-a092-1377ea6d23db service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updated VIF entry in instance network info cache for port a3411818-f27e-4611-bd69-b00b67614770. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:54:36 user nova-compute[74295]: DEBUG nova.network.neutron [req-3515e6c8-540e-40f4-8a9f-e5082587cf7f req-b6d6d0a4-f8f0-4fd6-a092-1377ea6d23db service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updating instance_info_cache with network_info: [{"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:54:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3515e6c8-540e-40f4-8a9f-e5082587cf7f req-b6d6d0a4-f8f0-4fd6-a092-1377ea6d23db service nova] Releasing lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:54:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:42 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:54:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:45 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1a69164-d3a5-4531-a067-161923f10060 is timed out.
Oct 26 06:54:45 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully detached device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the live domain config.
Oct 26 06:54:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZOfzATn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:54:45 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa0e14c-377b-49a8-95a1-219c5f9dd1ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:54:45 user nova-compute[74295]: No targets found.
Oct 26 06:54:45 user nova-compute[74295]: iSNS:
Oct 26 06:54:45 user nova-compute[74295]: No targets found.
Oct 26 06:54:45 user nova-compute[74295]: STATIC:
Oct 26 06:54:45 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc
Oct 26 06:54:45 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:54:45 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:54:45 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:54:45 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:54:45 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:54:45 user nova-compute[74295]: FIRMWARE:
Oct 26 06:54:45 user nova-compute[74295]: No targets found.
Oct 26 06:54:45 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:54:45 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:54:45 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ff39f4-8cf7-4ae9-a54b-dc0e80103a4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb057df-0e88-4d29-8333-c7765e72d6d6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:54:45 user nova-compute[74295]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc (non-flash)
Oct 26 06:54:45 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:54:45 user nova-compute[74295]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc (non-flash)
Oct 26 06:54:45 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac25c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fef562-8f52-451c-81c6-5bc628580751]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b274e77-7e65-4838-9118-7af6024c819b]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d8bae-ba0b-4fd5-8662-2d4a8c937a20]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.077s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[519977d9-96da-407e-bb25-b0a3fa6591f5]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d8650b-e1d4-403b-bde5-4b9a9130f984]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aeb803-685f-4ff6-8410-a13dc0be9350]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc, portal: 172.16.0.220,3260]
Oct 26 06:54:45 user nova-compute[74295]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc, portal: 172.16.0.220,3260] successful.
Oct 26 06:54:45 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a3453c-0077-4569-8c4d-77602e0956bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[125b6367-21af-4fff-bec5-261abe62c53a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== disconnect_volume: return (351ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:54:45 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG nova.objects.instance [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG nova.objects.instance [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4137b3da-57b0-4bee-a103-d4cba7727947 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.440s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:54:46 user nova-compute[74295]: INFO nova.compute.manager [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Attaching volume d58e2422-166d-4090-a460-97706901fe90 to /dev/vdb
Oct 26 06:54:46 user nova-compute[74295]: DEBUG os_brick.utils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[883cfdc5-bda6-4472-bb17-e6646108c72a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0188a1f3-a5ea-4ae7-b910-4ec54d27d99f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c3c479-cb56-4ae2-b97c-a76bdf19fb4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1302248c-4d9e-4567-9049-fb1182c82989]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:54:46 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:54:46 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e82c529-d502-4416-bb30-e5ffc523843e]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG os_brick.utils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:54:46 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updating existing volume attachment record: a1448f4c-b0fc-40a7-906b-620d0eb115d4 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:54:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:54:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNOxVhmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:55:05 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:55:05 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:55:05 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2e0a7f-5d9d-4c3f-ae1f-58a573528ccb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:55:05 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[41431c25-7a5d-4745-a3b3-04a018440bbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90] added
Oct 26 06:55:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca06b811-27f2-4c16-9fcf-cfa2fae1ea94]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e370e-24e0-44f1-9815-865289bad8c8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNOxVhmE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNOxVhmE" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b92f0e-2c2a-4025-81cc-e2ec001f006b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RNOxVhmE'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[815fd8f0-23ae-4be7-af86-dddb13083c19]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b1938-59c0-43ff-a1ba-5a5542039ed7]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8fca1a-1568-45a5-96a4-81534ac765bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90, portal: 172.16.0.220,3260]
Oct 26 06:55:05 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90, portal: 172.16.0.220,3260] successful.
Oct 26 06:55:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abdfecf-b382-4d20-88f5-965b2a0d14b2]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3b46e0-ed12-41f7-9a5b-a61af90ac44d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:05 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:05 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:05 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab413f0-4a77-4f55-9a01-a5d2ac9562de]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:55:05 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNOxVhmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:55:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:55:06 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23130303634356165', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:55:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130303634356165', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:55:06 user nova-compute[74295]: DEBUG nova.objects.instance [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:55:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:55:06 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:55:06 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:55:06 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:55:06 user nova-compute[74295]:   <serial>d58e2422-166d-4090-a460-97706901fe90</serial>
Oct 26 06:55:06 user nova-compute[74295]: </disk>
Oct 26 06:55:06 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:55:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:55:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:55:06 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No VIF found with MAC fa:16:3e:ce:01:06, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:55:07 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d5882a28-fcb4-488d-8a71-67fdcbdbcadc tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.345s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:55:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:55:13 user nova-compute[74295]: INFO nova.compute.manager [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Attaching volume a59cdd33-4e16-4bf2-9dc3-4d300229539c to /dev/vdc
Oct 26 06:55:13 user nova-compute[74295]: DEBUG os_brick.utils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[77887454-bc64-425f-9386-d6168175a8e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f1458d-2611-4a5b-bfb6-27691f32cf78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85503a2-14b6-4e67-9280-60b8b4864870]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8de9b07-07be-4006-8d8a-d60ece6a5d21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:55:13 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:55:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac301c0-c20d-41ac-8ac1-8c5b94a26a89]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG os_brick.utils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:55:13 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updating existing volume attachment record: 7e79837f-46b5-49d5-9977-a7ae8fd7578f {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:55:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:55:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:55:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:55:24 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:55:25 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:55:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:55:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:55:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:55:25 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:55:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:25 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:55:26 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:27 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:55:27 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8221MB free_disk=25.106983184814453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 69104a0e-4896-4677-999c-1e5173103e8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 467bed28-02e4-439d-9b81-75831d638340 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 022f5750-b856-488f-8312-249885868bff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 5749e61b-a89c-4279-93db-56586f314c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:55:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:55:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:55:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:55:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:55:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:55:30 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:55:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:55:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:55:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:55:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:55:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:55:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:55:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updating instance_info_cache with network_info: [{"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:55:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-69104a0e-4896-4677-999c-1e5173103e8b" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:55:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:55:34 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:55:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBYTdEjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:55:35 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:55:35 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:55:35 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf15ce6-9ef8-42a4-b83e-6a38158ff684]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:55:35 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f5ccec-45c1-43dd-b8c7-a847b2db9a36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c] added
Oct 26 06:55:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efea114-994d-4853-b52f-794026c3c981]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b7e41-c1c4-47d4-97b6-acf4a0884937]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBYTdEjP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBYTdEjP" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6abf99-5e1a-4c3e-8d1d-21588cbfa381]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WBYTdEjP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b069d3-a321-4c31-b7f1-4316f1ab4def]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e156ee-66c6-4a9e-82b3-861ca0f20df9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:35 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:35 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:55:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[88350de5-c4b4-4c76-bd6e-c0e64e0ddfb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c, portal: 172.16.0.220,3260]
Oct 26 06:55:36 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c, portal: 172.16.0.220,3260] successful.
Oct 26 06:55:36 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1202aec9-53a9-4fa2-8b62-795abb7fdfb6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f67899-d427-44b2-8c1a-e9bcfb3654a2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:36 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:36 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:55:36 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:36 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:36 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:55:36 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6c85ef-5725-41e3-b8e3-3f4822ee3574]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG nova.objects.instance [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:55:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBYTdEjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23663633031636130', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663633031636130', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:55:37 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:55:37 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:55:37 user nova-compute[74295]:   <target dev="vdc" bus="virtio"/>
Oct 26 06:55:37 user nova-compute[74295]:   <serial>a59cdd33-4e16-4bf2-9dc3-4d300229539c</serial>
Oct 26 06:55:37 user nova-compute[74295]: </disk>
Oct 26 06:55:37 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] No VIF found with MAC fa:16:3e:ce:01:06, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:55:37 user nova-compute[74295]: INFO nova.compute.manager [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attaching volume 85a74630-7d60-4b46-826e-f30832a63866 to /dev/vdb
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.utils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2b7dca-7489-4f86-bc4f-85a3cf7d9cb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf64a5f-e8fe-45ac-8b16-92abfd69280d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[645413d8-24df-43be-8137-b7cc62dd76ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8876ee2d-e5e4-4072-a201-f8b985fff0ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6c0cc8d7-77bd-4df5-b862-0684655ef1c7 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.417s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:55:37 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:55:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9a8ece-5ae1-483c-9683-e271a9a4af61]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG os_brick.utils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating existing volume attachment record: ca77b16a-c6f0-464b-9fa9-322daf711197 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:55:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:55:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:55:38 user nova-compute[74295]: INFO nova.compute.manager [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Detaching volume d58e2422-166d-4090-a460-97706901fe90
Oct 26 06:55:38 user nova-compute[74295]: INFO nova.virt.block_device [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Attempting to driver detach volume d58e2422-166d-4090-a460-97706901fe90 from mountpoint /dev/vdb
Oct 26 06:55:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Attempting to detach device vdb from instance 69104a0e-4896-4677-999c-1e5173103e8b from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:55:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:55:38 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:55:38 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:55:38 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:55:38 user nova-compute[74295]:   <serial>d58e2422-166d-4090-a460-97706901fe90</serial>
Oct 26 06:55:38 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:55:38 user nova-compute[74295]: </disk>
Oct 26 06:55:38 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:55:38 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully detached device vdb from instance 69104a0e-4896-4677-999c-1e5173103e8b from the persistent domain config.
Oct 26 06:55:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69104a0e-4896-4677-999c-1e5173103e8b from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:55:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:55:38 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:55:38 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:55:38 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:55:38 user nova-compute[74295]:   <serial>d58e2422-166d-4090-a460-97706901fe90</serial>
Oct 26 06:55:38 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:55:38 user nova-compute[74295]: </disk>
Oct 26 06:55:38 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:55:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:55:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-c25bcc0a-eb3c-4acb-ab74-68b65d6e6b6e req-b61b69c4-ac94-462b-9d41-8455d3901896 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received event network-changed-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:55:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-c25bcc0a-eb3c-4acb-ab74-68b65d6e6b6e req-b61b69c4-ac94-462b-9d41-8455d3901896 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Refreshing instance network info cache due to event network-changed-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:55:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c25bcc0a-eb3c-4acb-ab74-68b65d6e6b6e req-b61b69c4-ac94-462b-9d41-8455d3901896 service nova] Acquiring lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:55:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c25bcc0a-eb3c-4acb-ab74-68b65d6e6b6e req-b61b69c4-ac94-462b-9d41-8455d3901896 service nova] Acquired lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:55:43 user nova-compute[74295]: DEBUG nova.network.neutron [req-c25bcc0a-eb3c-4acb-ab74-68b65d6e6b6e req-b61b69c4-ac94-462b-9d41-8455d3901896 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Refreshing network info cache for port 88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:55:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-c25bcc0a-eb3c-4acb-ab74-68b65d6e6b6e req-b61b69c4-ac94-462b-9d41-8455d3901896 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updated VIF entry in instance network info cache for port 88f9bc45-5a84-4bf1-bd66-b4d425a49dbc. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:55:44 user nova-compute[74295]: DEBUG nova.network.neutron [req-c25bcc0a-eb3c-4acb-ab74-68b65d6e6b6e req-b61b69c4-ac94-462b-9d41-8455d3901896 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updating instance_info_cache with network_info: [{"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:55:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c25bcc0a-eb3c-4acb-ab74-68b65d6e6b6e req-b61b69c4-ac94-462b-9d41-8455d3901896 service nova] Releasing lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:55:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-a28c33e2-16bc-4c28-ab79-a16454f4b5b0 req-cc19499a-46d0-405d-927e-a216a1232093 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received event network-changed-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:55:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-a28c33e2-16bc-4c28-ab79-a16454f4b5b0 req-cc19499a-46d0-405d-927e-a216a1232093 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Refreshing instance network info cache due to event network-changed-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:55:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a28c33e2-16bc-4c28-ab79-a16454f4b5b0 req-cc19499a-46d0-405d-927e-a216a1232093 service nova] Acquiring lock "refresh_cache-022f5750-b856-488f-8312-249885868bff" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:55:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a28c33e2-16bc-4c28-ab79-a16454f4b5b0 req-cc19499a-46d0-405d-927e-a216a1232093 service nova] Acquired lock "refresh_cache-022f5750-b856-488f-8312-249885868bff" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:55:47 user nova-compute[74295]: DEBUG nova.network.neutron [req-a28c33e2-16bc-4c28-ab79-a16454f4b5b0 req-cc19499a-46d0-405d-927e-a216a1232093 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Refreshing network info cache for port e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "022f5750-b856-488f-8312-249885868bff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG nova.objects.instance [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'flavor' on Instance uuid 022f5750-b856-488f-8312-249885868bff {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:55:48 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Ignoring supplied device name: /dev/vdb
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "022f5750-b856-488f-8312-249885868bff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:55:48 user nova-compute[74295]: INFO nova.compute.manager [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Attaching volume 6cc8e795-c01d-4d5f-a62f-a92c2714244f to /dev/vdb
Oct 26 06:55:48 user nova-compute[74295]: DEBUG os_brick.utils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6541b0e-8c81-49ad-b2ed-a27adfa65dc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e7241f-0ba1-4eea-ba69-2fdf351c1e6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116d4b4-61c6-4e67-a97c-fc5b93805d5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d246b7-3f0f-479e-bc97-0f872fc86038]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:55:48 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca00a5f7-ea86-4840-8029-98eba3bb8498]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG os_brick.utils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Updating existing volume attachment record: 68f4d251-d44c-48d7-96db-c30450d4763c {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG nova.network.neutron [req-a28c33e2-16bc-4c28-ab79-a16454f4b5b0 req-cc19499a-46d0-405d-927e-a216a1232093 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Updated VIF entry in instance network info cache for port e2f0a1f7-13fc-455b-96bd-cd0cd5f74885. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG nova.network.neutron [req-a28c33e2-16bc-4c28-ab79-a16454f4b5b0 req-cc19499a-46d0-405d-927e-a216a1232093 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Updating instance_info_cache with network_info: [{"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:55:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a28c33e2-16bc-4c28-ab79-a16454f4b5b0 req-cc19499a-46d0-405d-927e-a216a1232093 service nova] Releasing lock "refresh_cache-022f5750-b856-488f-8312-249885868bff" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:55:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMxBLvsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:55:56 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:55:56 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:55:56 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[34133d19-6368-40f0-a7ec-5f7b044f7bdf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:55:56 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdfc580-69fd-4bd7-ae73-88776fc845d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866] added
Oct 26 06:55:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef29cb-b846-48ad-a898-3befccc2e783]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ba751a-1f4e-401f-8f6f-ab85d56ced91]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMxBLvsJ {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMxBLvsJ" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade6e5db-f9ae-4523-9b73-66ccddd9bcf8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qMxBLvsJ'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[44134640-189f-4c14-a640-52932863a953]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3950445e-3df0-4086-a53b-30b05e0d9dcc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:55:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:55:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb548a1-8895-4eeb-ac89-aa0fba55c34b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866, portal: 172.16.0.220,3260]
Oct 26 06:55:56 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866, portal: 172.16.0.220,3260] successful.
Oct 26 06:55:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[359af633-17a8-418a-9c2c-baf8f96d5b35]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b9750c-5389-4bce-9b36-dd9ad659e15b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:55:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:55:56 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:55:56 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0082c5ca-7eec-486a-83fb-a4fa1b2c3e70]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:55:56 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMxBLvsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:55:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:55:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26339303963376538', 'path': '/dev/sde'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:55:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339303963376538', 'path': '/dev/sde'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:55:57 user nova-compute[74295]: DEBUG nova.objects.instance [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:55:57 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:55:57 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:55:57 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:55:57 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:55:57 user nova-compute[74295]:   <serial>85a74630-7d60-4b46-826e-f30832a63866</serial>
Oct 26 06:55:57 user nova-compute[74295]: </disk>
Oct 26 06:55:57 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:55:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:55:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:55:58 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No VIF found with MAC fa:16:3e:dd:27:97, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:55:58 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-bfdb4275-ca28-4f5a-b840-81d4985aac1f tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.739s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:55:59 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69104a0e-4896-4677-999c-1e5173103e8b is timed out.
Oct 26 06:55:59 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully detached device vdb from instance 69104a0e-4896-4677-999c-1e5173103e8b from the live domain config.
Oct 26 06:55:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNOxVhmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:55:59 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f710d61b-e367-4f56-9091-7da27779b59a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:55:59 user nova-compute[74295]: No targets found.
Oct 26 06:55:59 user nova-compute[74295]: iSNS:
Oct 26 06:55:59 user nova-compute[74295]: No targets found.
Oct 26 06:55:59 user nova-compute[74295]: STATIC:
Oct 26 06:55:59 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866
Oct 26 06:55:59 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:55:59 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:55:59 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90
Oct 26 06:55:59 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:55:59 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:55:59 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:55:59 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:55:59 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:55:59 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c
Oct 26 06:55:59 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:55:59 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:55:59 user nova-compute[74295]: FIRMWARE:
Oct 26 06:55:59 user nova-compute[74295]: No targets found.
Oct 26 06:55:59 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:55:59 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:55:59 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ab9853-7ec7-435e-b094-85f3f4b7bd0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eccc34e-7a90-4707-b542-5dba97daa3c8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:59 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:59 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:55:59 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:55:59 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:55:59 user nova-compute[74295]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 (non-flash)
Oct 26 06:55:59 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:55:59 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:55:59 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1bbd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcc95a0-cc54-4770-90af-ccd8e8f125b3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dd3e73-f10b-4c65-8059-6704fcfd6d5f]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d221eb6-1edf-40af-9b70-23521046d900]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d008e4-8cd6-4be4-9284-4c3c621041f0]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b61d575-8e9a-47ce-a480-e6404d6195f0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d30df97-e2c4-41dc-aa16-0566c06a5c53]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90, portal: 172.16.0.220,3260]
Oct 26 06:55:59 user nova-compute[74295]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90, portal: 172.16.0.220,3260] successful.
Oct 26 06:55:59 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d58e2422-166d-4090-a460-97706901fe90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[efecf863-9adb-4566-94f3-43b5d2ebbdeb]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== disconnect_volume: return (323ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:55:59 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:56:00 user nova-compute[74295]: DEBUG nova.objects.instance [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:56:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-62a13c12-d149-4d17-a9d3-4cbb9ca225bb tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.834s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:00 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:00 user nova-compute[74295]: INFO nova.compute.manager [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Detaching volume 85a74630-7d60-4b46-826e-f30832a63866
Oct 26 06:56:00 user nova-compute[74295]: INFO nova.virt.block_device [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attempting to driver detach volume 85a74630-7d60-4b46-826e-f30832a63866 from mountpoint /dev/vdb
Oct 26 06:56:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Attempting to detach device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:56:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:56:00 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:56:00 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:56:00 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:56:00 user nova-compute[74295]:   <serial>85a74630-7d60-4b46-826e-f30832a63866</serial>
Oct 26 06:56:00 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:56:00 user nova-compute[74295]: </disk>
Oct 26 06:56:00 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:56:00 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully detached device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the persistent domain config.
Oct 26 06:56:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1a69164-d3a5-4531-a067-161923f10060 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:56:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:56:00 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:56:00 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:56:00 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:56:00 user nova-compute[74295]:   <serial>85a74630-7d60-4b46-826e-f30832a63866</serial>
Oct 26 06:56:00 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:56:00 user nova-compute[74295]: </disk>
Oct 26 06:56:00 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:56:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:56:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:01 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:01 user nova-compute[74295]: INFO nova.compute.manager [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Detaching volume a59cdd33-4e16-4bf2-9dc3-4d300229539c
Oct 26 06:56:01 user nova-compute[74295]: INFO nova.virt.block_device [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Attempting to driver detach volume a59cdd33-4e16-4bf2-9dc3-4d300229539c from mountpoint /dev/vdc
Oct 26 06:56:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Attempting to detach device vdc from instance 69104a0e-4896-4677-999c-1e5173103e8b from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:56:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:56:01 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:56:01 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:56:01 user nova-compute[74295]:   <target dev="vdc" bus="virtio"/>
Oct 26 06:56:01 user nova-compute[74295]:   <serial>a59cdd33-4e16-4bf2-9dc3-4d300229539c</serial>
Oct 26 06:56:01 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 06:56:01 user nova-compute[74295]: </disk>
Oct 26 06:56:01 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:56:01 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully detached device vdc from instance 69104a0e-4896-4677-999c-1e5173103e8b from the persistent domain config.
Oct 26 06:56:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 69104a0e-4896-4677-999c-1e5173103e8b from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:56:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:56:01 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:56:01 user nova-compute[74295]:   <source dev="/dev/sdd"/>
Oct 26 06:56:01 user nova-compute[74295]:   <target dev="vdc" bus="virtio"/>
Oct 26 06:56:01 user nova-compute[74295]:   <serial>a59cdd33-4e16-4bf2-9dc3-4d300229539c</serial>
Oct 26 06:56:01 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 06:56:01 user nova-compute[74295]: </disk>
Oct 26 06:56:01 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:56:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:56:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-57ded831-9cbc-47fa-bda8-fc86cff69be8 req-8cc02815-a4e2-4b8b-8a9e-4dcca40b9d7e service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-changed-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-57ded831-9cbc-47fa-bda8-fc86cff69be8 req-8cc02815-a4e2-4b8b-8a9e-4dcca40b9d7e service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Refreshing instance network info cache due to event network-changed-eec1cce7-3079-4a81-80a5-019a4f7fa7eb. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:56:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-57ded831-9cbc-47fa-bda8-fc86cff69be8 req-8cc02815-a4e2-4b8b-8a9e-4dcca40b9d7e service nova] Acquiring lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:56:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-57ded831-9cbc-47fa-bda8-fc86cff69be8 req-8cc02815-a4e2-4b8b-8a9e-4dcca40b9d7e service nova] Acquired lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:56:12 user nova-compute[74295]: DEBUG nova.network.neutron [req-57ded831-9cbc-47fa-bda8-fc86cff69be8 req-8cc02815-a4e2-4b8b-8a9e-4dcca40b9d7e service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Refreshing network info cache for port eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:56:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:13 user nova-compute[74295]: DEBUG nova.network.neutron [req-57ded831-9cbc-47fa-bda8-fc86cff69be8 req-8cc02815-a4e2-4b8b-8a9e-4dcca40b9d7e service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updated VIF entry in instance network info cache for port eec1cce7-3079-4a81-80a5-019a4f7fa7eb. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:56:13 user nova-compute[74295]: DEBUG nova.network.neutron [req-57ded831-9cbc-47fa-bda8-fc86cff69be8 req-8cc02815-a4e2-4b8b-8a9e-4dcca40b9d7e service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating instance_info_cache with network_info: [{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:56:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-57ded831-9cbc-47fa-bda8-fc86cff69be8 req-8cc02815-a4e2-4b8b-8a9e-4dcca40b9d7e service nova] Releasing lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:56:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNWmLatU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:56:18 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:56:18 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:56:18 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d150df75-92ea-41f1-aad6-bbd554e23838]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:56:18 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[daee2514-b6b4-47f6-a706-6575c31e1b6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f] added
Oct 26 06:56:18 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa3e4e-2e70-482f-8d09-2b123e762155]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.136s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dfa059-9c46-4d10-8e49-60fb6b8c5dc0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNWmLatU {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNWmLatU" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eb3fd5-8c80-4167-929e-4634ea9c2e60]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DNWmLatU'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[85da1964-3c97-434e-88b8-0b3a17f9f4a6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca7fcc-4ad2-4bb8-9ace-dc09557dace5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:18 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:56:18 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:56:18 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:18 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:56:18 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:56:18 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94350e8-1d85-4b2c-8a08-a4daacb04969]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f, portal: 172.16.0.220,3260]
Oct 26 06:56:18 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f, portal: 172.16.0.220,3260] successful.
Oct 26 06:56:18 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:18 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[25749429-8579-4d78-9653-7a5b036641f3]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac01955f-74a2-4a44-8070-61cad2a0f56c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:19 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:56:19 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:56:19 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:19 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:19 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:56:19 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:56:19 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:19 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[379dc286-5b78-4162-97a6-dc6f2b8a3c7c]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNWmLatU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:19 user nova-compute[74295]: INFO nova.compute.manager [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Shelving
Oct 26 06:56:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '26535386566313434', 'path': '/dev/sdc'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535386566313434', 'path': '/dev/sdc'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.objects.instance [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'flavor' on Instance uuid 022f5750-b856-488f-8312-249885868bff {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-e216b6bd-cc2e-4a7e-bec2-c811c1ccd93e req-85680734-1cd3-44e3-82d9-a93318ada8bc service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-unplugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e216b6bd-cc2e-4a7e-bec2-c811c1ccd93e req-85680734-1cd3-44e3-82d9-a93318ada8bc service nova] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e216b6bd-cc2e-4a7e-bec2-c811c1ccd93e req-85680734-1cd3-44e3-82d9-a93318ada8bc service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-e216b6bd-cc2e-4a7e-bec2-c811c1ccd93e req-85680734-1cd3-44e3-82d9-a93318ada8bc service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-e216b6bd-cc2e-4a7e-bec2-c811c1ccd93e req-85680734-1cd3-44e3-82d9-a93318ada8bc service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] No waiting events found dispatching network-vif-unplugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:56:20 user nova-compute[74295]: WARNING nova.compute.manager [req-e216b6bd-cc2e-4a7e-bec2-c811c1ccd93e req-85680734-1cd3-44e3-82d9-a93318ada8bc service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received unexpected event network-vif-unplugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb for instance with vm_state active and task_state shelving.
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:56:20 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:56:20 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:56:20 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:56:20 user nova-compute[74295]:   <serial>6cc8e795-c01d-4d5f-a62f-a92c2714244f</serial>
Oct 26 06:56:20 user nova-compute[74295]: </disk>
Oct 26 06:56:20 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:56:20 user nova-compute[74295]: INFO nova.compute.claims [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Claim successful on node user
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:56:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance destroyed successfully.
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:56:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Beginning cold snapshot process
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] No VIF found with MAC fa:16:3e:d3:30:e5, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:56:20 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.policy [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f8c68bbe2245c6b6f159c45e006216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fe63ca1f244085963c38b864dff1db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-413cf31c-5d82-4c1c-b9b0-629b2bec3c50 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.423s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:20 user nova-compute[74295]: INFO nova.virt.block_device [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Booting with volume 8a3b8734-fbd5-492d-8572-626d378860ba at /dev/vda
Oct 26 06:56:20 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk /opt/stack/data/nova/instances/snapshots/tmpbgs6jitu/a15f1c15db15458f9e3816dde4ed2c9a {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG os_brick.utils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9f9179-ca5e-4670-9f63-a7da95bf17b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[584e1bfa-fcfe-4729-abf4-3f4151f404f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b0723a-ac09-42d3-85f1-73dc66a028e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd26f7f-7972-4c5b-b072-8ef2b5c6fc95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:56:21 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc06f50-ba88-4540-8040-7bdac128016e]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.utils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updating existing volume attachment record: 3c0b5b51-3ecd-475a-9d16-22d5fe26fedf {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:56:21 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1a69164-d3a5-4531-a067-161923f10060 is timed out.
Oct 26 06:56:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully detached device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the live domain config.
Oct 26 06:56:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMxBLvsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:56:21 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3cf640-0159-4eb9-a42a-74777db2cfe4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:56:21 user nova-compute[74295]: No targets found.
Oct 26 06:56:21 user nova-compute[74295]: iSNS:
Oct 26 06:56:21 user nova-compute[74295]: No targets found.
Oct 26 06:56:21 user nova-compute[74295]: STATIC:
Oct 26 06:56:21 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866
Oct 26 06:56:21 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:56:21 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:56:21 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f
Oct 26 06:56:21 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:56:21 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:56:21 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:56:21 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:56:21 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:56:21 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c
Oct 26 06:56:21 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:56:21 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:56:21 user nova-compute[74295]: FIRMWARE:
Oct 26 06:56:21 user nova-compute[74295]: No targets found.
Oct 26 06:56:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:56:21 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:56:21 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f65af8e-3caa-47bb-9575-ea575141b6c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[af297c03-40dd-4223-b91b-42b0dd3ff363]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:21 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:56:21 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:56:21 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:21 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:56:21 user nova-compute[74295]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 (non-flash)
Oct 26 06:56:21 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1bae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866'): ({'sde'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Removing single pathed devices sde {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64a5eae-e4cc-4011-af70-3390ff9f2224]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[12903621-f6e7-4bc6-b948-4411baf3342a]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Flushing IO for device /dev/sde {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6966381b-2854-4d01-b6de-eb6f9a7f94ee]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4212e6db-f1a3-48cc-883c-3034e5f68cb7]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90ef1e3-ec61-4f25-a71c-58375ef676df]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334a1d0-d852-4b2a-8297-7d8bfc61ed6b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866, portal: 172.16.0.220,3260]
Oct 26 06:56:21 user nova-compute[74295]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866, portal: 172.16.0.220,3260] successful.
Oct 26 06:56:21 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85a74630-7d60-4b46-826e-f30832a63866 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f23fc21-397f-415d-b032-996c38d3b499]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== disconnect_volume: return (386ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Successfully created port: b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:56:21 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk /opt/stack/data/nova/instances/snapshots/tmpbgs6jitu/a15f1c15db15458f9e3816dde4ed2c9a" returned: 0 in 1.053s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Snapshot extracted, beginning image upload
Oct 26 06:56:21 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 69104a0e-4896-4677-999c-1e5173103e8b is timed out.
Oct 26 06:56:22 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully detached device vdc from instance 69104a0e-4896-4677-999c-1e5173103e8b from the live domain config.
Oct 26 06:56:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBYTdEjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:56:22 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd0bb2a-73f7-4fd4-9da0-68487cb97c59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:56:22 user nova-compute[74295]: No targets found.
Oct 26 06:56:22 user nova-compute[74295]: iSNS:
Oct 26 06:56:22 user nova-compute[74295]: No targets found.
Oct 26 06:56:22 user nova-compute[74295]: STATIC:
Oct 26 06:56:22 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f
Oct 26 06:56:22 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:56:22 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:56:22 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:56:22 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:56:22 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:56:22 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c
Oct 26 06:56:22 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:56:22 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:56:22 user nova-compute[74295]: FIRMWARE:
Oct 26 06:56:22 user nova-compute[74295]: No targets found.
Oct 26 06:56:22 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:56:22 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:56:22 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf018529-c259-4a2b-ab8d-2e721505be78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b22780-f3e7-43da-8d4a-e219d6d2f58f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:22 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:56:22 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:22 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:22 user nova-compute[74295]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c (non-flash)
Oct 26 06:56:22 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:22 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac512950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28eb034-ff8c-40db-b669-33d29c340097]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[27161282-6b0d-4f7e-b7b3-26058e5c30dc]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-c7562c88-b821-4d4d-9640-a3a5166f2027 req-d1f4051c-c628-4f05-abd3-963e75008e59 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c7562c88-b821-4d4d-9640-a3a5166f2027 req-d1f4051c-c628-4f05-abd3-963e75008e59 service nova] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c7562c88-b821-4d4d-9640-a3a5166f2027 req-d1f4051c-c628-4f05-abd3-963e75008e59 service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c7562c88-b821-4d4d-9640-a3a5166f2027 req-d1f4051c-c628-4f05-abd3-963e75008e59 service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-c7562c88-b821-4d4d-9640-a3a5166f2027 req-d1f4051c-c628-4f05-abd3-963e75008e59 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] No waiting events found dispatching network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:56:22 user nova-compute[74295]: WARNING nova.compute.manager [req-c7562c88-b821-4d4d-9640-a3a5166f2027 req-d1f4051c-c628-4f05-abd3-963e75008e59 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received unexpected event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4be50fe-b9a8-4f0b-b81b-4280b20ed56e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.092s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[733829b1-1b93-45e8-8547-57047e687dfb]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a0efa7-e8b9-44ad-9b3d-7a959a9eb33e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[680f99c1-5d82-4400-9e65-270d279b72e6]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c, portal: 172.16.0.220,3260]
Oct 26 06:56:22 user nova-compute[74295]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c, portal: 172.16.0.220,3260] successful.
Oct 26 06:56:22 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a59cdd33-4e16-4bf2-9dc3-4d300229539c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4c1259-b525-4455-98a9-1f3945996d7c]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] <== disconnect_volume: return (363ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Successfully updated port: b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquired lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG nova.network.neutron [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updating instance_info_cache with network_info: [{"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Releasing lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Instance network_info: |[{"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:56:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG nova.objects.instance [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'flavor' on Instance uuid 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-94146d71-d26a-449f-8802-8ed165f5f061 tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.937s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:23 user nova-compute[74295]: INFO nova.compute.manager [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Terminating instance
Oct 26 06:56:23 user nova-compute[74295]: DEBUG nova.compute.manager [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-d017b56a-94e8-4443-9e0e-d21613caed90 req-6a760060-cbc1-411b-911f-bc846af90bb2 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received event network-vif-unplugged-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d017b56a-94e8-4443-9e0e-d21613caed90 req-6a760060-cbc1-411b-911f-bc846af90bb2 service nova] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d017b56a-94e8-4443-9e0e-d21613caed90 req-6a760060-cbc1-411b-911f-bc846af90bb2 service nova] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d017b56a-94e8-4443-9e0e-d21613caed90 req-6a760060-cbc1-411b-911f-bc846af90bb2 service nova] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-d017b56a-94e8-4443-9e0e-d21613caed90 req-6a760060-cbc1-411b-911f-bc846af90bb2 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] No waiting events found dispatching network-vif-unplugged-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-d017b56a-94e8-4443-9e0e-d21613caed90 req-6a760060-cbc1-411b-911f-bc846af90bb2 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received event network-vif-unplugged-a3411818-f27e-4611-bd69-b00b67614770 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-2a64a1d1-7793-4a0e-b0be-812652740fef req-da9fad24-ded5-4296-b700-4553f3c78a28 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received event network-changed-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-2a64a1d1-7793-4a0e-b0be-812652740fef req-da9fad24-ded5-4296-b700-4553f3c78a28 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Refreshing instance network info cache due to event network-changed-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2a64a1d1-7793-4a0e-b0be-812652740fef req-da9fad24-ded5-4296-b700-4553f3c78a28 service nova] Acquiring lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2a64a1d1-7793-4a0e-b0be-812652740fef req-da9fad24-ded5-4296-b700-4553f3c78a28 service nova] Acquired lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.network.neutron [req-2a64a1d1-7793-4a0e-b0be-812652740fef req-da9fad24-ded5-4296-b700-4553f3c78a28 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Refreshing network info cache for port b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Snapshot image upload complete
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:56:24 user nova-compute[74295]: INFO nova.compute.manager [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Shelve offloading
Oct 26 06:56:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance destroyed successfully.
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.network.neutron [req-2a64a1d1-7793-4a0e-b0be-812652740fef req-da9fad24-ded5-4296-b700-4553f3c78a28 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updated VIF entry in instance network info cache for port b00605b4-ffb8-4da5-8545-f78e7e5fb9e9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.network.neutron [req-2a64a1d1-7793-4a0e-b0be-812652740fef req-da9fad24-ded5-4296-b700-4553f3c78a28 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updating instance_info_cache with network_info: [{"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquired lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.network.neutron [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:56:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Instance destroyed successfully.
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.objects.instance [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lazy-loading 'resources' on Instance uuid 69104a0e-4896-4677-999c-1e5173103e8b {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2a64a1d1-7793-4a0e-b0be-812652740fef req-da9fad24-ded5-4296-b700-4553f3c78a28 service nova] Releasing lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1192256602',display_name='tempest-AttachVolumeTestJSON-server-1192256602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1192256602',id=43,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaLR1LI9Y9KTldYRDrRbERgqew4a8dUX1e56hGwSPugjNzCGrzdlRMgAQyqCRQfO2UbnKi7CYtmsHhxRpuZq9V2tz2EUceaV992hWp0hLmCdV05S0DKR1SSW6Dflp02kg==',key_name='tempest-keypair-1292959742',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:52:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f36efc5cdc4cf5a61b0807a1235ba4',ramdisk_id='',reservation_id='r-8dgxhd6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93311543',owner_user_name='tempest-AttachVolumeTestJSON-93311543-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:52:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c0aa0cb8a174036bb890dca38df6e7d',uuid=69104a0e-4896-4677-999c-1e5173103e8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converting VIF {"id": "a3411818-f27e-4611-bd69-b00b67614770", "address": "fa:16:3e:ce:01:06", "network": {"id": "0c1b6616-ab94-4f66-9d0e-619b986660cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-888905470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f36efc5cdc4cf5a61b0807a1235ba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3411818-f2", "ovs_interfaceid": "a3411818-f27e-4611-bd69-b00b67614770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:01:06,bridge_name='br-int',has_traffic_filtering=True,id=a3411818-f27e-4611-bd69-b00b67614770,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3411818-f2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG os_vif [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:01:06,bridge_name='br-int',has_traffic_filtering=True,id=a3411818-f27e-4611-bd69-b00b67614770,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3411818-f2') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3411818-f2, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=332d7ee8-2539-44a2-828f-315012696485) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:24 user nova-compute[74295]: INFO os_vif [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:01:06,bridge_name='br-int',has_traffic_filtering=True,id=a3411818-f27e-4611-bd69-b00b67614770,network=Network(0c1b6616-ab94-4f66-9d0e-619b986660cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3411818-f2')
Oct 26 06:56:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Deleting instance files /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b_del
Oct 26 06:56:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Deletion of /opt/stack/data/nova/instances/69104a0e-4896-4677-999c-1e5173103e8b_del complete
Oct 26 06:56:24 user nova-compute[74295]: INFO nova.compute.manager [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 26 06:56:24 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:56:24 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG nova.network.neutron [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating instance_info_cache with network_info: [{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Releasing lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:56:25 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Took 0.73 seconds to deallocate network for instance.
Oct 26 06:56:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-d4588355-89a3-4359-b356-be757040eed2 req-ce1bb289-3a6e-4c8c-99d9-2299f1ef1a1f service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received event network-vif-deleted-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:25 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Deleted allocations for instance 69104a0e-4896-4677-999c-1e5173103e8b
Oct 26 06:56:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance destroyed successfully.
Oct 26 06:56:25 user nova-compute[74295]: DEBUG nova.objects.instance [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'resources' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1628253072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1628253072',id=46,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBHdg/Ng2JnVD3A+ZVC2yiJGHaG39oVppuiWnjfhemy4nwp0brDK+xBtnuqoM8+q4/fWy4ldBf8vD3rmVGELnr4tgj51nJ9TinQJUiTWxJMFKlM7clTV1tMHTQ9fgreOg==',key_name='tempest-keypair-1359324483',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-1540cl09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member',shelved_at='2023-10-26T06:56:24.510032',shelved_host='user',shelved_image_id='b5840a7d-020b-405a-aa35-8714666f1f81'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:56:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=5749e61b-a89c-4279-93db-56586f314c4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG os_vif [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeec1cce7-30, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ecfac5e-0390-48a9-bdd1-424ec89a60e9) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:25 user nova-compute[74295]: INFO os_vif [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30')
Oct 26 06:56:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Deleting instance files /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c_del
Oct 26 06:56:25 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Deletion of /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c_del complete
Oct 26 06:56:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-dffe5487-aab4-4241-ab91-338d78e9f4af tempest-AttachVolumeTestJSON-93311543 tempest-AttachVolumeTestJSON-93311543-project-member] Lock "69104a0e-4896-4677-999c-1e5173103e8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.078s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:26 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Deleted allocations for instance 5749e61b-a89c-4279-93db-56586f314c4c
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.objects.instance [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'numa_topology' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.objects.base [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<5749e61b-a89c-4279-93db-56586f314c4c> lazy-loaded attributes: resources,numa_topology {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-7ca052ae-8a26-4ff4-8528-f1d04478caf5 req-bc9075e6-c55f-4137-b0dd-ea43658ece96 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received event network-vif-plugged-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7ca052ae-8a26-4ff4-8528-f1d04478caf5 req-bc9075e6-c55f-4137-b0dd-ea43658ece96 service nova] Acquiring lock "69104a0e-4896-4677-999c-1e5173103e8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7ca052ae-8a26-4ff4-8528-f1d04478caf5 req-bc9075e6-c55f-4137-b0dd-ea43658ece96 service nova] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7ca052ae-8a26-4ff4-8528-f1d04478caf5 req-bc9075e6-c55f-4137-b0dd-ea43658ece96 service nova] Lock "69104a0e-4896-4677-999c-1e5173103e8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-7ca052ae-8a26-4ff4-8528-f1d04478caf5 req-bc9075e6-c55f-4137-b0dd-ea43658ece96 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] No waiting events found dispatching network-vif-plugged-a3411818-f27e-4611-bd69-b00b67614770 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:56:26 user nova-compute[74295]: WARNING nova.compute.manager [req-7ca052ae-8a26-4ff4-8528-f1d04478caf5 req-bc9075e6-c55f-4137-b0dd-ea43658ece96 service nova] [instance: 69104a0e-4896-4677-999c-1e5173103e8b] Received unexpected event network-vif-plugged-a3411818-f27e-4611-bd69-b00b67614770 for instance with vm_state deleted and task_state None.
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-4b117b76-00e5-4141-9a60-c915ce4887f5 req-1b071c9e-af09-407b-acbc-d0d73e18b850 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-changed-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-4b117b76-00e5-4141-9a60-c915ce4887f5 req-1b071c9e-af09-407b-acbc-d0d73e18b850 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Refreshing instance network info cache due to event network-changed-eec1cce7-3079-4a81-80a5-019a4f7fa7eb. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4b117b76-00e5-4141-9a60-c915ce4887f5 req-1b071c9e-af09-407b-acbc-d0d73e18b850 service nova] Acquiring lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4b117b76-00e5-4141-9a60-c915ce4887f5 req-1b071c9e-af09-407b-acbc-d0d73e18b850 service nova] Acquired lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.network.neutron [req-4b117b76-00e5-4141-9a60-c915ce4887f5 req-1b071c9e-af09-407b-acbc-d0d73e18b850 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Refreshing network info cache for port eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e35925f-d477-420f-9d1d-4122559aa9fb tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.704s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.network.neutron [req-4b117b76-00e5-4141-9a60-c915ce4887f5 req-1b071c9e-af09-407b-acbc-d0d73e18b850 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updated VIF entry in instance network info cache for port eec1cce7-3079-4a81-80a5-019a4f7fa7eb. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG nova.network.neutron [req-4b117b76-00e5-4141-9a60-c915ce4887f5 req-1b071c9e-af09-407b-acbc-d0d73e18b850 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating instance_info_cache with network_info: [{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapeec1cce7-30", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:56:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4b117b76-00e5-4141-9a60-c915ce4887f5 req-1b071c9e-af09-407b-acbc-d0d73e18b850 service nova] Releasing lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:56:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:27 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:56:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:56:28 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:56:28 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:56:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8536MB free_disk=25.102649688720703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 467bed28-02e4-439d-9b81-75831d638340 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 022f5750-b856-488f-8312-249885868bff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c0f4d485-a8cf-4465-a7d9-8b00d3b02afa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:56:28 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:56:29 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:56:29 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:56:29 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:56:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:56:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:34 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:56:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:56:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:56:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 467bed28-02e4-439d-9b81-75831d638340] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:56:35 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updating instance_info_cache with network_info: [{"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:56:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:56:35 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:56:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:56:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9e6d0694-0d7d-456f-981d-93769c1e8fea tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 38.637s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:56:39 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Creating image(s)
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Did not create local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Ensure instance console log exists: /opt/stack/data/nova/instances/c0f4d485-a8cf-4465-a7d9-8b00d3b02afa/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Start _get_guest_xml network_info=[{"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '3c0b5b51-3ecd-475a-9d16-22d5fe26fedf', 'boot_index': 0, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRkmjnlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0f4d485-a8cf-4465-a7d9-8b00d3b02afa', 'attached_at': '', 'detached_at': '', 'volume_id': '8a3b8734-fbd5-492d-8572-626d378860ba', 'serial': '8a3b8734-fbd5-492d-8572-626d378860ba'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:56:39 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:56:39 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRkmjnlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:56:39 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:56:39 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:56:39 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa1a271-f522-4631-a96f-55aa087509f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:56:39 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e5045a-4763-4950-ae4d-d19a7118f2a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba] added
Oct 26 06:56:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b6ffca-de97-4a2c-8374-fc0dd4e2cc0b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[52820279-caa1-468f-bbba-45c9f9f1a085]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRkmjnlI {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRkmjnlI" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea73eb-5b36-4b55-843e-048a434d8d56]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LRkmjnlI'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[868a6168-37e9-49f7-8a91-d9f5064d840b]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[14207bc3-61cd-44d8-a0f7-aa57320e66fa]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:39 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:39 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:39 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:56:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28b9932-6d4c-411d-89f7-5006738d7055]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba, portal: 172.16.0.220,3260]
Oct 26 06:56:40 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba, portal: 172.16.0.220,3260] successful.
Oct 26 06:56:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd71cc2-be85-463c-b9d4-d92623098d14]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e89fc0a-162e-4670-b106-0e4e89bca7d5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:40 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:40 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:56:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:56:40 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:56:40 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:56:40 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f33383d-dc12-408c-85d3-db1d17c0923b]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:56:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRkmjnlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26364343261643837', 'path': '/dev/sdd'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364343261643837', 'path': '/dev/sdd'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-736447763',display_name='tempest-TestVolumeBootPattern-server-736447763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-736447763',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO37LOfLGVLm8denc0aiOr8WCYx77Qraf7D47fN50S5LIaTBdJywjgiKJrg/08AIIVYLPW9NSG8sjHJOCwCiCGyrZMujB/2p5ls6F3JGSk5q17MYb1TgqAWMzwRKoYJlRg==',key_name='tempest-TestVolumeBootPattern-373663211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-ja65unv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:56:21Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=c0f4d485-a8cf-4465-a7d9-8b00d3b02afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:35,bridge_name='br-int',has_traffic_filtering=True,id=b00605b4-ffb8-4da5-8545-f78e7e5fb9e9,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00605b4-ff') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.objects.instance [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'pci_devices' on Instance uuid c0f4d485-a8cf-4465-a7d9-8b00d3b02afa {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:56:41 user nova-compute[74295]:   <uuid>c0f4d485-a8cf-4465-a7d9-8b00d3b02afa</uuid>
Oct 26 06:56:41 user nova-compute[74295]:   <name>instance-0000002f</name>
Oct 26 06:56:41 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:56:41 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:56:41 user nova-compute[74295]:   <metadata>
Oct 26 06:56:41 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:56:41 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:56:41 user nova-compute[74295]:       <nova:name>tempest-TestVolumeBootPattern-server-736447763</nova:name>
Oct 26 06:56:41 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:56:39</nova:creationTime>
Oct 26 06:56:41 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:56:41 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:56:41 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:56:41 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:56:41 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:56:41 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:56:41 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:56:41 user nova-compute[74295]:       <nova:owner>
Oct 26 06:56:41 user nova-compute[74295]:         <nova:user uuid="11f8c68bbe2245c6b6f159c45e006216">tempest-TestVolumeBootPattern-594294549-project-member</nova:user>
Oct 26 06:56:41 user nova-compute[74295]:         <nova:project uuid="75fe63ca1f244085963c38b864dff1db">tempest-TestVolumeBootPattern-594294549</nova:project>
Oct 26 06:56:41 user nova-compute[74295]:       </nova:owner>
Oct 26 06:56:41 user nova-compute[74295]:       <nova:ports>
Oct 26 06:56:41 user nova-compute[74295]:         <nova:port uuid="b00605b4-ffb8-4da5-8545-f78e7e5fb9e9">
Oct 26 06:56:41 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 06:56:41 user nova-compute[74295]:         </nova:port>
Oct 26 06:56:41 user nova-compute[74295]:       </nova:ports>
Oct 26 06:56:41 user nova-compute[74295]:     </nova:instance>
Oct 26 06:56:41 user nova-compute[74295]:   </metadata>
Oct 26 06:56:41 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:56:41 user nova-compute[74295]:     <system>
Oct 26 06:56:41 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:56:41 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:56:41 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:56:41 user nova-compute[74295]:       <entry name="serial">c0f4d485-a8cf-4465-a7d9-8b00d3b02afa</entry>
Oct 26 06:56:41 user nova-compute[74295]:       <entry name="uuid">c0f4d485-a8cf-4465-a7d9-8b00d3b02afa</entry>
Oct 26 06:56:41 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:56:41 user nova-compute[74295]:     </system>
Oct 26 06:56:41 user nova-compute[74295]:   </sysinfo>
Oct 26 06:56:41 user nova-compute[74295]:   <os>
Oct 26 06:56:41 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:56:41 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:56:41 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:56:41 user nova-compute[74295]:   </os>
Oct 26 06:56:41 user nova-compute[74295]:   <features>
Oct 26 06:56:41 user nova-compute[74295]:     <acpi/>
Oct 26 06:56:41 user nova-compute[74295]:     <apic/>
Oct 26 06:56:41 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:56:41 user nova-compute[74295]:   </features>
Oct 26 06:56:41 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:56:41 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:56:41 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:56:41 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:56:41 user nova-compute[74295]:   </clock>
Oct 26 06:56:41 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:56:41 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:56:41 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:56:41 user nova-compute[74295]:   </cpu>
Oct 26 06:56:41 user nova-compute[74295]:   <devices>
Oct 26 06:56:41 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 06:56:41 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:56:41 user nova-compute[74295]:       <source dev="/dev/sdd"/>
Oct 26 06:56:41 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:56:41 user nova-compute[74295]:       <serial>8a3b8734-fbd5-492d-8572-626d378860ba</serial>
Oct 26 06:56:41 user nova-compute[74295]:     </disk>
Oct 26 06:56:41 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:56:41 user nova-compute[74295]:       <mac address="fa:16:3e:bd:e2:35"/>
Oct 26 06:56:41 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:56:41 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:56:41 user nova-compute[74295]:       <target dev="tapb00605b4-ff"/>
Oct 26 06:56:41 user nova-compute[74295]:     </interface>
Oct 26 06:56:41 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:56:41 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/c0f4d485-a8cf-4465-a7d9-8b00d3b02afa/console.log" append="off"/>
Oct 26 06:56:41 user nova-compute[74295]:     </serial>
Oct 26 06:56:41 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:56:41 user nova-compute[74295]:     <video>
Oct 26 06:56:41 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:56:41 user nova-compute[74295]:     </video>
Oct 26 06:56:41 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:56:41 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:56:41 user nova-compute[74295]:     </rng>
Oct 26 06:56:41 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:56:41 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:56:41 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:56:41 user nova-compute[74295]:     </memballoon>
Oct 26 06:56:41 user nova-compute[74295]:   </devices>
Oct 26 06:56:41 user nova-compute[74295]: </domain>
Oct 26 06:56:41 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-736447763',display_name='tempest-TestVolumeBootPattern-server-736447763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-736447763',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO37LOfLGVLm8denc0aiOr8WCYx77Qraf7D47fN50S5LIaTBdJywjgiKJrg/08AIIVYLPW9NSG8sjHJOCwCiCGyrZMujB/2p5ls6F3JGSk5q17MYb1TgqAWMzwRKoYJlRg==',key_name='tempest-TestVolumeBootPattern-373663211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-ja65unv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:56:21Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=c0f4d485-a8cf-4465-a7d9-8b00d3b02afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:35,bridge_name='br-int',has_traffic_filtering=True,id=b00605b4-ffb8-4da5-8545-f78e7e5fb9e9,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00605b4-ff') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG os_vif [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:35,bridge_name='br-int',has_traffic_filtering=True,id=b00605b4-ffb8-4da5-8545-f78e7e5fb9e9,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00605b4-ff') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '324f41a3-8222-5f6e-889c-79ee8fc5164b', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb00605b4-ff, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb00605b4-ff, col_values=(('qos', UUID('bb6e3221-a4e1-4fcb-87be-a150b259a962')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb00605b4-ff, col_values=(('external_ids', {'iface-id': 'b00605b4-ffb8-4da5-8545-f78e7e5fb9e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:e2:35', 'vm-uuid': 'c0f4d485-a8cf-4465-a7d9-8b00d3b02afa'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:41 user nova-compute[74295]: INFO os_vif [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:e2:35,bridge_name='br-int',has_traffic_filtering=True,id=b00605b4-ffb8-4da5-8545-f78e7e5fb9e9,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00605b4-ff')
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:56:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] No VIF found with MAC fa:16:3e:bd:e2:35, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-c418b668-c94d-4e2c-8e01-caf79abe1830 req-3d0c0e8f-bb78-42f2-955a-2b7a4d457c09 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received event network-vif-plugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c418b668-c94d-4e2c-8e01-caf79abe1830 req-3d0c0e8f-bb78-42f2-955a-2b7a4d457c09 service nova] Acquiring lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c418b668-c94d-4e2c-8e01-caf79abe1830 req-3d0c0e8f-bb78-42f2-955a-2b7a4d457c09 service nova] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c418b668-c94d-4e2c-8e01-caf79abe1830 req-3d0c0e8f-bb78-42f2-955a-2b7a4d457c09 service nova] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-c418b668-c94d-4e2c-8e01-caf79abe1830 req-3d0c0e8f-bb78-42f2-955a-2b7a4d457c09 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] No waiting events found dispatching network-vif-plugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:56:42 user nova-compute[74295]: WARNING nova.compute.manager [req-c418b668-c94d-4e2c-8e01-caf79abe1830 req-3d0c0e8f-bb78-42f2-955a-2b7a4d457c09 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received unexpected event network-vif-plugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 for instance with vm_state building and task_state spawning.
Oct 26 06:56:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:56:44 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Instance spawned successfully.
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:56:44 user nova-compute[74295]: INFO nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Took 4.88 seconds to spawn the instance on the hypervisor.
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-6053f1c9-7cd9-46ea-ad4a-ee05fa9ac562 req-ab6fb86f-bebc-481a-bcdf-a789d5aff37d service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received event network-vif-plugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6053f1c9-7cd9-46ea-ad4a-ee05fa9ac562 req-ab6fb86f-bebc-481a-bcdf-a789d5aff37d service nova] Acquiring lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6053f1c9-7cd9-46ea-ad4a-ee05fa9ac562 req-ab6fb86f-bebc-481a-bcdf-a789d5aff37d service nova] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6053f1c9-7cd9-46ea-ad4a-ee05fa9ac562 req-ab6fb86f-bebc-481a-bcdf-a789d5aff37d service nova] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-6053f1c9-7cd9-46ea-ad4a-ee05fa9ac562 req-ab6fb86f-bebc-481a-bcdf-a789d5aff37d service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] No waiting events found dispatching network-vif-plugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:56:44 user nova-compute[74295]: WARNING nova.compute.manager [req-6053f1c9-7cd9-46ea-ad4a-ee05fa9ac562 req-ab6fb86f-bebc-481a-bcdf-a789d5aff37d service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received unexpected event network-vif-plugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 for instance with vm_state building and task_state spawning.
Oct 26 06:56:44 user nova-compute[74295]: INFO nova.compute.manager [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Took 24.52 seconds to build instance.
Oct 26 06:56:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-0147612e-3af0-4e80-a6e4-bfe13f05bd62 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.645s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:56:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:56:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:56 user nova-compute[74295]: DEBUG nova.objects.instance [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:56:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:56:57 user nova-compute[74295]: INFO nova.compute.manager [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attaching volume 551bf527-5e37-42f2-9ee9-f24d3adf9019 to /dev/vdb
Oct 26 06:56:57 user nova-compute[74295]: DEBUG os_brick.utils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b35a8e-d888-4848-b846-5c0c1ffb530c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b650968f-6267-4d45-b9a8-0dd35b29a081]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[57917888-4270-424b-8cf3-41cdc781e76a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e9f46-15fd-4bd7-83af-97fd20fa491d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 06:56:57 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 06:56:57 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8b603f-42dd-4c6c-a988-e28dc01500a1]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG os_brick.utils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating existing volume attachment record: b0fc6570-cfd9-45c2-9463-0e2782eb2b55 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 06:56:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "022f5750-b856-488f-8312-249885868bff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:57:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:57:14 user nova-compute[74295]: INFO nova.compute.manager [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Detaching volume 6cc8e795-c01d-4d5f-a62f-a92c2714244f
Oct 26 06:57:14 user nova-compute[74295]: INFO nova.virt.block_device [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Attempting to driver detach volume 6cc8e795-c01d-4d5f-a62f-a92c2714244f from mountpoint /dev/vdb
Oct 26 06:57:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Attempting to detach device vdb from instance 022f5750-b856-488f-8312-249885868bff from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:57:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:57:14 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:57:14 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:57:14 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:57:14 user nova-compute[74295]:   <serial>6cc8e795-c01d-4d5f-a62f-a92c2714244f</serial>
Oct 26 06:57:14 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:57:14 user nova-compute[74295]: </disk>
Oct 26 06:57:14 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:57:14 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Successfully detached device vdb from instance 022f5750-b856-488f-8312-249885868bff from the persistent domain config.
Oct 26 06:57:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 022f5750-b856-488f-8312-249885868bff from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:57:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:57:14 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:57:14 user nova-compute[74295]:   <source dev="/dev/sdc"/>
Oct 26 06:57:14 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:57:14 user nova-compute[74295]:   <serial>6cc8e795-c01d-4d5f-a62f-a92c2714244f</serial>
Oct 26 06:57:14 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:57:14 user nova-compute[74295]: </disk>
Oct 26 06:57:14 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:57:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "022f5750-b856-488f-8312-249885868bff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:57:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 022f5750-b856-488f-8312-249885868bff {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:57:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBzXGdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:57:24 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:57:24 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:57:24 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8f1232-c4e3-4364-a1b8-7c0dfb572a38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 06:57:24 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7859f105-6f1c-490f-a9a6-d088024867e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019] added
Oct 26 06:57:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9f0b31-bca9-433f-9014-e4c7e14b1994]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0579bf-e053-4abe-bca0-2bba5779d305]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQBzXGdI {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQBzXGdI" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0593305-88b4-45b7-a0f4-9ac93bf96797]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yQBzXGdI'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e3690f-2d6a-42e2-88b9-715507757a70]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[413509ff-c1e8-482b-b1d6-aa10ad7df694]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[349c9e1d-2066-4bb6-9e13-b6187eb5328f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019, portal: 172.16.0.220,3260]
Oct 26 06:57:24 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019, portal: 172.16.0.220,3260] successful.
Oct 26 06:57:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[597dcdc4-e5ae-4716-bcc6-d74534ff52ab]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[89db68e6-3987-402b-a63b-2f10ecd361bb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)
Oct 26 06:57:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:24 user nova-compute[74295]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)
Oct 26 06:57:24 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c429ddb3-f413-4dac-b32a-34114741fd8b]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:24 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:57:25 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 06:57:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBzXGdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 06:57:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:57:25 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23131373163323162', 'path': '/dev/sde'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:57:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131373163323162', 'path': '/dev/sde'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 06:57:25 user nova-compute[74295]: DEBUG nova.objects.instance [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:57:25 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 06:57:25 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:57:25 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:57:25 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:57:25 user nova-compute[74295]:   <serial>551bf527-5e37-42f2-9ee9-f24d3adf9019</serial>
Oct 26 06:57:25 user nova-compute[74295]: </disk>
Oct 26 06:57:25 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 06:57:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:57:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:57:26 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] No VIF found with MAC fa:16:3e:dd:27:97, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:57:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-db3ad8c9-5406-40de-8709-1b59d7e4f3ec tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.302s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:57:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:57:28 user nova-compute[74295]: INFO nova.compute.manager [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Detaching volume 551bf527-5e37-42f2-9ee9-f24d3adf9019
Oct 26 06:57:28 user nova-compute[74295]: INFO nova.virt.block_device [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Attempting to driver detach volume 551bf527-5e37-42f2-9ee9-f24d3adf9019 from mountpoint /dev/vdb
Oct 26 06:57:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Attempting to detach device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 06:57:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:57:28 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:57:28 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:57:28 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:57:28 user nova-compute[74295]:   <serial>551bf527-5e37-42f2-9ee9-f24d3adf9019</serial>
Oct 26 06:57:28 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:57:28 user nova-compute[74295]: </disk>
Oct 26 06:57:28 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:57:28 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully detached device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the persistent domain config.
Oct 26 06:57:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1a69164-d3a5-4531-a067-161923f10060 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 06:57:28 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 06:57:28 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 06:57:28 user nova-compute[74295]:   <source dev="/dev/sde"/>
Oct 26 06:57:28 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 06:57:28 user nova-compute[74295]:   <serial>551bf527-5e37-42f2-9ee9-f24d3adf9019</serial>
Oct 26 06:57:28 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 06:57:28 user nova-compute[74295]: </disk>
Oct 26 06:57:28 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 06:57:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 06:57:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:57:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:57:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:29 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:57:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:57:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:57:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:30 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:57:30 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:57:30 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=25.099929809570312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:57:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:57:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 467bed28-02e4-439d-9b81-75831d638340 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 022f5750-b856-488f-8312-249885868bff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance c0f4d485-a8cf-4465-a7d9-8b00d3b02afa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 06:57:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:57:34 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 06:57:35 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 022f5750-b856-488f-8312-249885868bff is timed out.
Oct 26 06:57:35 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Successfully detached device vdb from instance 022f5750-b856-488f-8312-249885868bff from the live domain config.
Oct 26 06:57:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNWmLatU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:57:35 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[480bd6cf-ab7c-4f72-8e53-3e2edc62e17e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:57:35 user nova-compute[74295]: No targets found.
Oct 26 06:57:35 user nova-compute[74295]: iSNS:
Oct 26 06:57:35 user nova-compute[74295]: No targets found.
Oct 26 06:57:35 user nova-compute[74295]: STATIC:
Oct 26 06:57:35 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f
Oct 26 06:57:35 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:35 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:35 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba
Oct 26 06:57:35 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:35 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:35 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019
Oct 26 06:57:35 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:35 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:35 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:57:35 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:35 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:35 user nova-compute[74295]: FIRMWARE:
Oct 26 06:57:35 user nova-compute[74295]: No targets found.
Oct 26 06:57:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:57:35 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:57:35 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b43a94-c77a-4ab9-9edc-434f404e4174]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5220ee4-34be-4441-82b1-1cabce8d4fd2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:35 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:57:35 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:35 user nova-compute[74295]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)
Oct 26 06:57:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:35 user nova-compute[74295]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f (non-flash)
Oct 26 06:57:35 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:35 user nova-compute[74295]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)
Oct 26 06:57:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35886c5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f'): ({'sdc'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Removing single pathed devices sdc {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aaebaa-6366-43e5-8bfc-651a2661af75]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54c964b-60f5-40fd-b4d4-a4c5bc7a4590]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Flushing IO for device /dev/sdc {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[313f26cf-276e-4e34-84f4-062d6179d8dc]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72d505-d25d-4199-8fae-1046087e722c]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] SCSI volumes sdc have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9909a53-b6ab-40de-95c9-971beda16210]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e4326f-69c3-4639-bba2-b00674212b0a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f, portal: 172.16.0.220,3260]
Oct 26 06:57:35 user nova-compute[74295]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f, portal: 172.16.0.220,3260] successful.
Oct 26 06:57:35 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbccff45-c1a8-45d6-ae86-3e5ad909b8fa]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] <== disconnect_volume: return (327ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:57:35 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'flavor' on Instance uuid 022f5750-b856-488f-8312-249885868bff {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6463989f-9d1a-4a55-a0cc-7de13c5cf870 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.923s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.795s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "022f5750-b856-488f-8312-249885868bff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:36 user nova-compute[74295]: INFO nova.compute.manager [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Terminating instance
Oct 26 06:57:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 022f5750-b856-488f-8312-249885868bff] Skipping network cache update for instance because it is being deleted. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-479ff6e8-b499-4e29-8139-31a2ae6e7011 req-ef4ceec9-221b-4ee9-867b-90f2b363a0d9 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received event network-vif-unplugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-479ff6e8-b499-4e29-8139-31a2ae6e7011 req-ef4ceec9-221b-4ee9-867b-90f2b363a0d9 service nova] Acquiring lock "022f5750-b856-488f-8312-249885868bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-479ff6e8-b499-4e29-8139-31a2ae6e7011 req-ef4ceec9-221b-4ee9-867b-90f2b363a0d9 service nova] Lock "022f5750-b856-488f-8312-249885868bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-479ff6e8-b499-4e29-8139-31a2ae6e7011 req-ef4ceec9-221b-4ee9-867b-90f2b363a0d9 service nova] Lock "022f5750-b856-488f-8312-249885868bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-479ff6e8-b499-4e29-8139-31a2ae6e7011 req-ef4ceec9-221b-4ee9-867b-90f2b363a0d9 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] No waiting events found dispatching network-vif-unplugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:57:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-479ff6e8-b499-4e29-8139-31a2ae6e7011 req-ef4ceec9-221b-4ee9-867b-90f2b363a0d9 service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received event network-vif-unplugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 022f5750-b856-488f-8312-249885868bff] Instance destroyed successfully.
Oct 26 06:57:37 user nova-compute[74295]: DEBUG nova.objects.instance [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lazy-loading 'resources' on Instance uuid 022f5750-b856-488f-8312-249885868bff {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1045752904',display_name='tempest-VolumesSnapshotTestJSON-instance-1045752904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1045752904',id=45,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7krK0l6DU3vA+wBlQV4I/9wyjFBh+yn2HXd5QFR2s7BmMxX06xmUxm5LBj0E9ExxDo0qbCdjs75JkeWjeRQTv/Fc8wZgvXozP0ZZRQqr0C5J+IesdIkKiSuEK3mMLcuA==',key_name='tempest-keypair-1109850942',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:54:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b43980edd6fd428a94283c56a896d717',ramdisk_id='',reservation_id='r-r1y60ojx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1927708355',owner_user_name='tempest-VolumesSnapshotTestJSON-1927708355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01f2b3710476458abc998271a7047156',uuid=022f5750-b856-488f-8312-249885868bff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converting VIF {"id": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "address": "fa:16:3e:d3:30:e5", "network": {"id": "41961a96-036e-4fbc-b083-8b7366d1272d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-860772280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43980edd6fd428a94283c56a896d717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0a1f7-13", "ovs_interfaceid": "e2f0a1f7-13fc-455b-96bd-cd0cd5f74885", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=e2f0a1f7-13fc-455b-96bd-cd0cd5f74885,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0a1f7-13') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_vif [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=e2f0a1f7-13fc-455b-96bd-cd0cd5f74885,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0a1f7-13') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2f0a1f7-13, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=566181a9-9d12-4da6-8dc9-4e5d80c0e694) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:57:37 user nova-compute[74295]: INFO os_vif [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=e2f0a1f7-13fc-455b-96bd-cd0cd5f74885,network=Network(41961a96-036e-4fbc-b083-8b7366d1272d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0a1f7-13')
Oct 26 06:57:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNWmLatU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:57:37 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb2e0a9-7a95-4301-9db0-0ab3ea8ff5d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:57:37 user nova-compute[74295]: No targets found.
Oct 26 06:57:37 user nova-compute[74295]: iSNS:
Oct 26 06:57:37 user nova-compute[74295]: No targets found.
Oct 26 06:57:37 user nova-compute[74295]: STATIC:
Oct 26 06:57:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba
Oct 26 06:57:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019
Oct 26 06:57:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:37 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:57:37 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:37 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:37 user nova-compute[74295]: FIRMWARE:
Oct 26 06:57:37 user nova-compute[74295]: No targets found.
Oct 26 06:57:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:57:37 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:57:37 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc8e795-c01d-4d5f-a62f-a92c2714244f', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f93594-a486-423a-b8e7-ab88ed42e5b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[96af5d7b-f7d4-4e5b-9f9c-b148153f9341]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:37 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:37 user nova-compute[74295]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)
Oct 26 06:57:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:37 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:37 user nova-compute[74295]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)
Oct 26 06:57:37 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35886c7130>, {}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Disconnecting from: [] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] <== disconnect_volume: return (75ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:57:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Deleting instance files /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff_del
Oct 26 06:57:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Deletion of /opt/stack/data/nova/instances/022f5750-b856-488f-8312-249885868bff_del complete
Oct 26 06:57:37 user nova-compute[74295]: INFO nova.compute.manager [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 26 06:57:37 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 022f5750-b856-488f-8312-249885868bff] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:57:37 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 022f5750-b856-488f-8312-249885868bff] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 022f5750-b856-488f-8312-249885868bff] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:57:38 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 022f5750-b856-488f-8312-249885868bff] Took 0.94 seconds to deallocate network for instance.
Oct 26 06:57:38 user nova-compute[74295]: WARNING nova.volume.cinder [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Attachment 68f4d251-d44c-48d7-96db-c30450d4763c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 68f4d251-d44c-48d7-96db-c30450d4763c. (HTTP 404) (Request-ID: req-ffc321ca-8f24-4e57-8636-c1a990fe071e)
Oct 26 06:57:38 user nova-compute[74295]: INFO nova.compute.manager [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] [instance: 022f5750-b856-488f-8312-249885868bff] Took 0.03 seconds to detach 1 volumes for instance.
Oct 26 06:57:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-d032beee-6718-49e5-8bac-65a3e7aecd67 req-cde55990-7ca1-46e2-8e5e-52f287a8303d service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received event network-vif-deleted-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:38 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Deleted allocations for instance 022f5750-b856-488f-8312-249885868bff
Oct 26 06:57:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-0bb4b171-f82f-4bdd-9241-e9db07bb6f4f req-2d814574-c8d5-4c42-9ac8-807e67d7940b service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received event network-vif-plugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0bb4b171-f82f-4bdd-9241-e9db07bb6f4f req-2d814574-c8d5-4c42-9ac8-807e67d7940b service nova] Acquiring lock "022f5750-b856-488f-8312-249885868bff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0bb4b171-f82f-4bdd-9241-e9db07bb6f4f req-2d814574-c8d5-4c42-9ac8-807e67d7940b service nova] Lock "022f5750-b856-488f-8312-249885868bff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0bb4b171-f82f-4bdd-9241-e9db07bb6f4f req-2d814574-c8d5-4c42-9ac8-807e67d7940b service nova] Lock "022f5750-b856-488f-8312-249885868bff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-0bb4b171-f82f-4bdd-9241-e9db07bb6f4f req-2d814574-c8d5-4c42-9ac8-807e67d7940b service nova] [instance: 022f5750-b856-488f-8312-249885868bff] No waiting events found dispatching network-vif-plugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:57:38 user nova-compute[74295]: WARNING nova.compute.manager [req-0bb4b171-f82f-4bdd-9241-e9db07bb6f4f req-2d814574-c8d5-4c42-9ac8-807e67d7940b service nova] [instance: 022f5750-b856-488f-8312-249885868bff] Received unexpected event network-vif-plugged-e2f0a1f7-13fc-455b-96bd-cd0cd5f74885 for instance with vm_state deleted and task_state None.
Oct 26 06:57:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-fe1bc507-9ac3-4606-baa1-f8fbf1aceab7 tempest-VolumesSnapshotTestJSON-1927708355 tempest-VolumesSnapshotTestJSON-1927708355-project-member] Lock "022f5750-b856-488f-8312-249885868bff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.358s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:57:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:57:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:57:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:57:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:49 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1a69164-d3a5-4531-a067-161923f10060 is timed out.
Oct 26 06:57:49 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully detached device vdb from instance a1a69164-d3a5-4531-a067-161923f10060 from the live domain config.
Oct 26 06:57:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQBzXGdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:57:49 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb64044-87e7-4572-ac81-83ed983116ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:57:49 user nova-compute[74295]: No targets found.
Oct 26 06:57:49 user nova-compute[74295]: iSNS:
Oct 26 06:57:49 user nova-compute[74295]: No targets found.
Oct 26 06:57:49 user nova-compute[74295]: STATIC:
Oct 26 06:57:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba
Oct 26 06:57:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019
Oct 26 06:57:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:49 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:57:49 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:57:49 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:57:49 user nova-compute[74295]: FIRMWARE:
Oct 26 06:57:49 user nova-compute[74295]: No targets found.
Oct 26 06:57:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:57:49 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:57:49 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[766cf6d1-35bc-472c-82a9-5e66687173c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3237ae18-535e-487c-9c81-b11abae50457]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:49 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:49 user nova-compute[74295]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)
Oct 26 06:57:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:57:49 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:57:49 user nova-compute[74295]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 (non-flash)
Oct 26 06:57:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac602d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019'): ({'sde'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Removing single pathed devices sde {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c839c52-d28f-47c9-9234-57fc5f17b23d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb61317d-6ce2-4b97-ad04-a91b8968e869]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Flushing IO for device /dev/sde {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a49700-50f8-45d2-942e-92c9f0eb9f6a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16fa7ad-aff5-456a-8f48-3049a062ca36]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] SCSI volumes sde have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0c242-07db-4fae-a614-143aa5f98122]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e9232-9e3f-4ea9-ad76-140b38340933]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019, portal: 172.16.0.220,3260]
Oct 26 06:57:49 user nova-compute[74295]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019, portal: 172.16.0.220,3260] successful.
Oct 26 06:57:49 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551bf527-5e37-42f2-9ee9-f24d3adf9019 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb2762-5c25-4bc9-805a-de68421be102]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] <== disconnect_volume: return (337ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:57:49 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:57:50 user nova-compute[74295]: DEBUG nova.objects.instance [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'flavor' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:57:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-642303c0-01b8-4be3-86e7-c23af5fb357c tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.954s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:57:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:57:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:58:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:58:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-f25e4198-451a-4cf6-b808-60ea414bfbad req-4a34e6bc-3a4f-4549-b7b1-a6555d9b419d service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received event network-changed-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG nova.compute.manager [req-f25e4198-451a-4cf6-b808-60ea414bfbad req-4a34e6bc-3a4f-4549-b7b1-a6555d9b419d service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Refreshing instance network info cache due to event network-changed-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f25e4198-451a-4cf6-b808-60ea414bfbad req-4a34e6bc-3a4f-4549-b7b1-a6555d9b419d service nova] Acquiring lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f25e4198-451a-4cf6-b808-60ea414bfbad req-4a34e6bc-3a4f-4549-b7b1-a6555d9b419d service nova] Acquired lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG nova.network.neutron [req-f25e4198-451a-4cf6-b808-60ea414bfbad req-4a34e6bc-3a4f-4549-b7b1-a6555d9b419d service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Refreshing network info cache for port b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:58:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:13 user nova-compute[74295]: INFO nova.compute.manager [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Unshelving
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'pci_requests' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'numa_topology' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:58:13 user nova-compute[74295]: INFO nova.compute.claims [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Claim successful on node user
Oct 26 06:58:13 user nova-compute[74295]: DEBUG nova.network.neutron [req-f25e4198-451a-4cf6-b808-60ea414bfbad req-4a34e6bc-3a4f-4549-b7b1-a6555d9b419d service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updated VIF entry in instance network info cache for port b00605b4-ffb8-4da5-8545-f78e7e5fb9e9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG nova.network.neutron [req-f25e4198-451a-4cf6-b808-60ea414bfbad req-4a34e6bc-3a4f-4549-b7b1-a6555d9b419d service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updating instance_info_cache with network_info: [{"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f25e4198-451a-4cf6-b808-60ea414bfbad req-4a34e6bc-3a4f-4549-b7b1-a6555d9b419d service nova] Releasing lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:13 user nova-compute[74295]: INFO nova.compute.manager [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Terminating instance
Oct 26 06:58:13 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:58:13 user nova-compute[74295]: INFO nova.network.neutron [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating port eec1cce7-3079-4a81-80a5-019a4f7fa7eb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 06:58:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-2e489930-b2f9-49b4-889a-3e10aebf71c6 req-331bff7b-ebcf-4069-90a9-3327d552b761 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received event network-vif-unplugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2e489930-b2f9-49b4-889a-3e10aebf71c6 req-331bff7b-ebcf-4069-90a9-3327d552b761 service nova] Acquiring lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2e489930-b2f9-49b4-889a-3e10aebf71c6 req-331bff7b-ebcf-4069-90a9-3327d552b761 service nova] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2e489930-b2f9-49b4-889a-3e10aebf71c6 req-331bff7b-ebcf-4069-90a9-3327d552b761 service nova] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-2e489930-b2f9-49b4-889a-3e10aebf71c6 req-331bff7b-ebcf-4069-90a9-3327d552b761 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] No waiting events found dispatching network-vif-unplugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-2e489930-b2f9-49b4-889a-3e10aebf71c6 req-331bff7b-ebcf-4069-90a9-3327d552b761 service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received event network-vif-unplugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:14 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Instance destroyed successfully.
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.objects.instance [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'resources' on Instance uuid c0f4d485-a8cf-4465-a7d9-8b00d3b02afa {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:56:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-736447763',display_name='tempest-TestVolumeBootPattern-server-736447763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-736447763',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO37LOfLGVLm8denc0aiOr8WCYx77Qraf7D47fN50S5LIaTBdJywjgiKJrg/08AIIVYLPW9NSG8sjHJOCwCiCGyrZMujB/2p5ls6F3JGSk5q17MYb1TgqAWMzwRKoYJlRg==',key_name='tempest-TestVolumeBootPattern-373663211',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-ja65unv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:56:45Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=c0f4d485-a8cf-4465-a7d9-8b00d3b02afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:e2:35,bridge_name='br-int',has_traffic_filtering=True,id=b00605b4-ffb8-4da5-8545-f78e7e5fb9e9,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00605b4-ff') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_vif [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:e2:35,bridge_name='br-int',has_traffic_filtering=True,id=b00605b4-ffb8-4da5-8545-f78e7e5fb9e9,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00605b4-ff') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb00605b4-ff, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb6e3221-a4e1-4fcb-87be-a150b259a962) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:58:14 user nova-compute[74295]: INFO os_vif [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:e2:35,bridge_name='br-int',has_traffic_filtering=True,id=b00605b4-ffb8-4da5-8545-f78e7e5fb9e9,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00605b4-ff')
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRkmjnlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:58:14 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquired lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4140792b-2f69-4d83-bfb2-299190b4667b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:58:14 user nova-compute[74295]: No targets found.
Oct 26 06:58:14 user nova-compute[74295]: iSNS:
Oct 26 06:58:14 user nova-compute[74295]: No targets found.
Oct 26 06:58:14 user nova-compute[74295]: STATIC:
Oct 26 06:58:14 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba
Oct 26 06:58:14 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:58:14 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:58:14 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:58:14 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:58:14 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:58:14 user nova-compute[74295]: FIRMWARE:
Oct 26 06:58:14 user nova-compute[74295]: No targets found.
Oct 26 06:58:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:58:14 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:58:14 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24e708e-f500-4222-88d4-9f5fccbc6d6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-8f6e1d19-8071-4337-8f1d-678e41e0a6c7 req-51ab9303-ba41-4d96-8018-0ea012ec41bb service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-changed-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG nova.compute.manager [req-8f6e1d19-8071-4337-8f1d-678e41e0a6c7 req-51ab9303-ba41-4d96-8018-0ea012ec41bb service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Refreshing instance network info cache due to event network-changed-eec1cce7-3079-4a81-80a5-019a4f7fa7eb. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8f6e1d19-8071-4337-8f1d-678e41e0a6c7 req-51ab9303-ba41-4d96-8018-0ea012ec41bb service nova] Acquiring lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef3f42e-6467-4718-80f5-a90cd9011234]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:58:14 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:58:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:58:14 user nova-compute[74295]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba (non-flash)
Oct 26 06:58:14 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac188040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba'): ({'sdd'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Removing single pathed devices sdd {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[90428497-c4e3-4c8b-a2f2-3d37881e6a7f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e546f-6efe-4418-aee7-6d9742b1bf6d]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flushing IO for device /dev/sdd {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ec620-8f5e-46ae-8b38-fdd9a66d4a0e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc03591-4f70-4893-95e0-7e09cd910179]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] SCSI volumes sdd have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f109bf-cbec-4aaa-b702-82fc4b6c2161]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:58:14 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-005f5c49-527b-4b6d-aa0a-0c21240b4523 req-27175353-42fc-4fb7-8bdd-00abc135563a service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received event network-changed-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-005f5c49-527b-4b6d-aa0a-0c21240b4523 req-27175353-42fc-4fb7-8bdd-00abc135563a service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Refreshing instance network info cache due to event network-changed-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-005f5c49-527b-4b6d-aa0a-0c21240b4523 req-27175353-42fc-4fb7-8bdd-00abc135563a service nova] Acquiring lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-005f5c49-527b-4b6d-aa0a-0c21240b4523 req-27175353-42fc-4fb7-8bdd-00abc135563a service nova] Acquired lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-005f5c49-527b-4b6d-aa0a-0c21240b4523 req-27175353-42fc-4fb7-8bdd-00abc135563a service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Refreshing network info cache for port b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04e1bec-752e-4297-a554-2b28f446ea93]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba, portal: 172.16.0.220,3260]
Oct 26 06:58:15 user nova-compute[74295]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba, portal: 172.16.0.220,3260] successful.
Oct 26 06:58:15 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a3b8734-fbd5-492d-8572-626d378860ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b04a6e-f1c1-4eb6-8027-884b2a283e9a]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== disconnect_volume: return (332ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:58:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Deleting instance files /opt/stack/data/nova/instances/c0f4d485-a8cf-4465-a7d9-8b00d3b02afa_del
Oct 26 06:58:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Deletion of /opt/stack/data/nova/instances/c0f4d485-a8cf-4465-a7d9-8b00d3b02afa_del complete
Oct 26 06:58:15 user nova-compute[74295]: INFO nova.compute.manager [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating instance_info_cache with network_info: [{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Releasing lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:58:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Creating image(s)
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8f6e1d19-8071-4337-8f1d-678e41e0a6c7 req-51ab9303-ba41-4d96-8018-0ea012ec41bb service nova] Acquired lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-8f6e1d19-8071-4337-8f1d-678e41e0a6c7 req-51ab9303-ba41-4d96-8018-0ea012ec41bb service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Refreshing network info cache for port eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG nova.objects.base [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<5749e61b-a89c-4279-93db-56586f314c4c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-c456573d-2296-4264-b3da-65c232b682d9 req-204659bb-023c-4fe3-ab6f-b0980de2b45c service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received event network-vif-plugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c456573d-2296-4264-b3da-65c232b682d9 req-204659bb-023c-4fe3-ab6f-b0980de2b45c service nova] Acquiring lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c456573d-2296-4264-b3da-65c232b682d9 req-204659bb-023c-4fe3-ab6f-b0980de2b45c service nova] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c456573d-2296-4264-b3da-65c232b682d9 req-204659bb-023c-4fe3-ab6f-b0980de2b45c service nova] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG nova.compute.manager [req-c456573d-2296-4264-b3da-65c232b682d9 req-204659bb-023c-4fe3-ab6f-b0980de2b45c service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] No waiting events found dispatching network-vif-plugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:58:16 user nova-compute[74295]: WARNING nova.compute.manager [req-c456573d-2296-4264-b3da-65c232b682d9 req-204659bb-023c-4fe3-ab6f-b0980de2b45c service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received unexpected event network-vif-plugged-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 for instance with vm_state active and task_state deleting.
Oct 26 06:58:16 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:58:16 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Took 1.34 seconds to deallocate network for instance.
Oct 26 06:58:16 user nova-compute[74295]: DEBUG nova.network.neutron [req-005f5c49-527b-4b6d-aa0a-0c21240b4523 req-27175353-42fc-4fb7-8bdd-00abc135563a service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updated VIF entry in instance network info cache for port b00605b4-ffb8-4da5-8545-f78e7e5fb9e9. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG nova.network.neutron [req-005f5c49-527b-4b6d-aa0a-0c21240b4523 req-27175353-42fc-4fb7-8bdd-00abc135563a service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updating instance_info_cache with network_info: [{"id": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "address": "fa:16:3e:bd:e2:35", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00605b4-ff", "ovs_interfaceid": "b00605b4-ffb8-4da5-8545-f78e7e5fb9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-005f5c49-527b-4b6d-aa0a-0c21240b4523 req-27175353-42fc-4fb7-8bdd-00abc135563a service nova] Releasing lock "refresh_cache-c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG nova.virt.images [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] b5840a7d-020b-405a-aa35-8714666f1f81 was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd.part /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG nova.network.neutron [req-8f6e1d19-8071-4337-8f1d-678e41e0a6c7 req-51ab9303-ba41-4d96-8018-0ea012ec41bb service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updated VIF entry in instance network info cache for port eec1cce7-3079-4a81-80a5-019a4f7fa7eb. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:58:16 user nova-compute[74295]: DEBUG nova.network.neutron [req-8f6e1d19-8071-4337-8f1d-678e41e0a6c7 req-51ab9303-ba41-4d96-8018-0ea012ec41bb service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating instance_info_cache with network_info: [{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8f6e1d19-8071-4337-8f1d-678e41e0a6c7 req-51ab9303-ba41-4d96-8018-0ea012ec41bb service nova] Releasing lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-78f1ec23-c666-494d-9005-7ba776fe0682 req-4cb24281-12f1-49d8-bcf4-f6c44625758e service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Received event network-vif-deleted-b00605b4-ffb8-4da5-8545-f78e7e5fb9e9 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:17 user nova-compute[74295]: INFO nova.compute.manager [req-78f1ec23-c666-494d-9005-7ba776fe0682 req-4cb24281-12f1-49d8-bcf4-f6c44625758e service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Neutron deleted interface b00605b4-ffb8-4da5-8545-f78e7e5fb9e9; detaching it from the instance and deleting it from the info cache
Oct 26 06:58:17 user nova-compute[74295]: DEBUG nova.network.neutron [req-78f1ec23-c666-494d-9005-7ba776fe0682 req-4cb24281-12f1-49d8-bcf4-f6c44625758e service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-78f1ec23-c666-494d-9005-7ba776fe0682 req-4cb24281-12f1-49d8-bcf4-f6c44625758e service nova] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Detach interface failed, port_id=b00605b4-ffb8-4da5-8545-f78e7e5fb9e9, reason: Instance c0f4d485-a8cf-4465-a7d9-8b00d3b02afa could not be found. {{(pid=74295) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd.part /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd.converted" returned: 0 in 0.538s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:17 user nova-compute[74295]: INFO nova.compute.manager [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: c0f4d485-a8cf-4465-a7d9-8b00d3b02afa] Took 0.86 seconds to detach 1 volumes for instance.
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.151s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd --force-share --output=json" returned: 0 in 0.333s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd,backing_fmt=raw /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd,backing_fmt=raw /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk 1073741824" returned: 0 in 0.057s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:18 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Deleted allocations for instance c0f4d485-a8cf-4465-a7d9-8b00d3b02afa
Oct 26 06:58:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'migration_context' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG nova.objects.base [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<5749e61b-a89c-4279-93db-56586f314c4c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:58:18 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Rebasing disk image.
Oct 26 06:58:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d9eb2690-8d2c-4aac-bb15-8ff13a1bfd2f tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "c0f4d485-a8cf-4465-a7d9-8b00d3b02afa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.358s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.168s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:18 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 -F raw /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 -F raw /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk" returned: 0 in 2.454s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Ensure instance console log exists: /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Start _get_guest_xml network_info=[{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1bb8ea83b5a8047230d8db4052f818e6',container_format='bare',created_at=2023-10-26T06:56:20Z,direct_url=<?>,disk_format='qcow2',id=b5840a7d-020b-405a-aa35-8714666f1f81,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1628253072-shelved',owner='74a74a5d314a4075923b5c21b2c39097',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T06:56:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:58:20 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:58:20 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1bb8ea83b5a8047230d8db4052f818e6',container_format='bare',created_at=2023-10-26T06:56:20Z,direct_url=<?>,disk_format='qcow2',id=b5840a7d-020b-405a-aa35-8714666f1f81,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1628253072-shelved',owner='74a74a5d314a4075923b5c21b2c39097',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T06:56:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.objects.base [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<5749e61b-a89c-4279-93db-56586f314c4c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1628253072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1628253072',id=46,image_ref='b5840a7d-020b-405a-aa35-8714666f1f81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1359324483',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-1540cl09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member',shelved_at='2023-10-26T06:56:24.510032',shelved_host='user',shelved_image_id='b5840a7d-020b-405a-aa35-8714666f1f81'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=5749e61b-a89c-4279-93db-56586f314c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'pci_devices' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.objects.base [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Object Instance<5749e61b-a89c-4279-93db-56586f314c4c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:58:20 user nova-compute[74295]:   <uuid>5749e61b-a89c-4279-93db-56586f314c4c</uuid>
Oct 26 06:58:20 user nova-compute[74295]:   <name>instance-0000002e</name>
Oct 26 06:58:20 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:58:20 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:58:20 user nova-compute[74295]:   <metadata>
Oct 26 06:58:20 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:58:20 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:58:20 user nova-compute[74295]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1628253072</nova:name>
Oct 26 06:58:20 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:58:20</nova:creationTime>
Oct 26 06:58:20 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:58:20 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:58:20 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:58:20 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:58:20 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:58:20 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:58:20 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:58:20 user nova-compute[74295]:       <nova:owner>
Oct 26 06:58:20 user nova-compute[74295]:         <nova:user uuid="8ce2ec6aad1e4e068958bcc61d50cb73">tempest-AttachVolumeShelveTestJSON-1252316399-project-member</nova:user>
Oct 26 06:58:20 user nova-compute[74295]:         <nova:project uuid="74a74a5d314a4075923b5c21b2c39097">tempest-AttachVolumeShelveTestJSON-1252316399</nova:project>
Oct 26 06:58:20 user nova-compute[74295]:       </nova:owner>
Oct 26 06:58:20 user nova-compute[74295]:       <nova:root type="image" uuid="b5840a7d-020b-405a-aa35-8714666f1f81"/>
Oct 26 06:58:20 user nova-compute[74295]:       <nova:ports>
Oct 26 06:58:20 user nova-compute[74295]:         <nova:port uuid="eec1cce7-3079-4a81-80a5-019a4f7fa7eb">
Oct 26 06:58:20 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 06:58:20 user nova-compute[74295]:         </nova:port>
Oct 26 06:58:20 user nova-compute[74295]:       </nova:ports>
Oct 26 06:58:20 user nova-compute[74295]:     </nova:instance>
Oct 26 06:58:20 user nova-compute[74295]:   </metadata>
Oct 26 06:58:20 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:58:20 user nova-compute[74295]:     <system>
Oct 26 06:58:20 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:58:20 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:58:20 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:58:20 user nova-compute[74295]:       <entry name="serial">5749e61b-a89c-4279-93db-56586f314c4c</entry>
Oct 26 06:58:20 user nova-compute[74295]:       <entry name="uuid">5749e61b-a89c-4279-93db-56586f314c4c</entry>
Oct 26 06:58:20 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:58:20 user nova-compute[74295]:     </system>
Oct 26 06:58:20 user nova-compute[74295]:   </sysinfo>
Oct 26 06:58:20 user nova-compute[74295]:   <os>
Oct 26 06:58:20 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:58:20 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:58:20 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:58:20 user nova-compute[74295]:   </os>
Oct 26 06:58:20 user nova-compute[74295]:   <features>
Oct 26 06:58:20 user nova-compute[74295]:     <acpi/>
Oct 26 06:58:20 user nova-compute[74295]:     <apic/>
Oct 26 06:58:20 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:58:20 user nova-compute[74295]:   </features>
Oct 26 06:58:20 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:58:20 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:58:20 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:58:20 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:58:20 user nova-compute[74295]:   </clock>
Oct 26 06:58:20 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:58:20 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:58:20 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:58:20 user nova-compute[74295]:   </cpu>
Oct 26 06:58:20 user nova-compute[74295]:   <devices>
Oct 26 06:58:20 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:58:20 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:58:20 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk"/>
Oct 26 06:58:20 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:58:20 user nova-compute[74295]:     </disk>
Oct 26 06:58:20 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:58:20 user nova-compute[74295]:       <mac address="fa:16:3e:87:d8:08"/>
Oct 26 06:58:20 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:58:20 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:58:20 user nova-compute[74295]:       <target dev="tapeec1cce7-30"/>
Oct 26 06:58:20 user nova-compute[74295]:     </interface>
Oct 26 06:58:20 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:58:20 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/console.log" append="off"/>
Oct 26 06:58:20 user nova-compute[74295]:     </serial>
Oct 26 06:58:20 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:58:20 user nova-compute[74295]:     <video>
Oct 26 06:58:20 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:58:20 user nova-compute[74295]:     </video>
Oct 26 06:58:20 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:58:20 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:58:20 user nova-compute[74295]:     </rng>
Oct 26 06:58:20 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:58:20 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:58:20 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:58:20 user nova-compute[74295]:     </memballoon>
Oct 26 06:58:20 user nova-compute[74295]:   </devices>
Oct 26 06:58:20 user nova-compute[74295]: </domain>
Oct 26 06:58:20 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1628253072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1628253072',id=46,image_ref='b5840a7d-020b-405a-aa35-8714666f1f81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1359324483',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-1540cl09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member',shelved_at='2023-10-26T06:56:24.510032',shelved_host='user',shelved_image_id='b5840a7d-020b-405a-aa35-8714666f1f81'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=5749e61b-a89c-4279-93db-56586f314c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG os_vif [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de1d1d40-2217-5c61-b4d3-616818b317d6', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeec1cce7-30, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeec1cce7-30, col_values=(('qos', UUID('121624f6-68ba-4a76-838b-8c7d7ec9e5b8')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeec1cce7-30, col_values=(('external_ids', {'iface-id': 'eec1cce7-3079-4a81-80a5-019a4f7fa7eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:d8:08', 'vm-uuid': '5749e61b-a89c-4279-93db-56586f314c4c'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:58:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:20 user nova-compute[74295]: INFO os_vif [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30')
Oct 26 06:58:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:58:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] No VIF found with MAC fa:16:3e:87:d8:08, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:58:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-48802c47-f7f8-40b8-8c96-f09f5f809797 req-2806b4bb-2715-492d-86d6-44f616d2a8a9 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-48802c47-f7f8-40b8-8c96-f09f5f809797 req-2806b4bb-2715-492d-86d6-44f616d2a8a9 service nova] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-48802c47-f7f8-40b8-8c96-f09f5f809797 req-2806b4bb-2715-492d-86d6-44f616d2a8a9 service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-48802c47-f7f8-40b8-8c96-f09f5f809797 req-2806b4bb-2715-492d-86d6-44f616d2a8a9 service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-48802c47-f7f8-40b8-8c96-f09f5f809797 req-2806b4bb-2715-492d-86d6-44f616d2a8a9 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] No waiting events found dispatching network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:58:22 user nova-compute[74295]: WARNING nova.compute.manager [req-48802c47-f7f8-40b8-8c96-f09f5f809797 req-2806b4bb-2715-492d-86d6-44f616d2a8a9 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received unexpected event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 06:58:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:24 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:58:24 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:58:24 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance spawned successfully.
Oct 26 06:58:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-c688407e-302e-41d7-a407-52e80944a1d3 req-6bc8e779-4b81-45a4-992f-64ba6a10626e service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c688407e-302e-41d7-a407-52e80944a1d3 req-6bc8e779-4b81-45a4-992f-64ba6a10626e service nova] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c688407e-302e-41d7-a407-52e80944a1d3 req-6bc8e779-4b81-45a4-992f-64ba6a10626e service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c688407e-302e-41d7-a407-52e80944a1d3 req-6bc8e779-4b81-45a4-992f-64ba6a10626e service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-c688407e-302e-41d7-a407-52e80944a1d3 req-6bc8e779-4b81-45a4-992f-64ba6a10626e service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] No waiting events found dispatching network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:58:24 user nova-compute[74295]: WARNING nova.compute.manager [req-c688407e-302e-41d7-a407-52e80944a1d3 req-6bc8e779-4b81-45a4-992f-64ba6a10626e service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received unexpected event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 06:58:25 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:58:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b71deab8-3a5f-4e61-868a-9c6803d6084d tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.786s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:30 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:58:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 06:58:31 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:58:31 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:58:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=25.09136962890625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:58:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 467bed28-02e4-439d-9b81-75831d638340 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 5749e61b-a89c-4279-93db-56586f314c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:58:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:58:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquiring lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 06:58:36 user nova-compute[74295]: INFO nova.compute.claims [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Claim successful on node user
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Skipping network cache update for instance because it is Building. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.network.neutron [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 06:58:36 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: a1a69164-d3a5-4531-a067-161923f10060] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 06:58:36 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Creating image(s)
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquiring lock "/opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "/opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "/opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:36 user nova-compute[74295]: DEBUG nova.policy [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdc0231474384741af6d53678b7acdc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ebd23fa6bec411bbfad6adafcf4fc4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating instance_info_cache with network_info: [{"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-a1a69164-d3a5-4531-a067-161923f10060" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk 1073741824" returned: 0 in 0.079s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Cannot resize image /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Ensure instance console log exists: /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:37 user nova-compute[74295]: DEBUG nova.network.neutron [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Successfully created port: fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 06:58:38 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:38 user nova-compute[74295]: DEBUG nova.network.neutron [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Successfully updated port: fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 06:58:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquiring lock "refresh_cache-059afcda-0cf1-4d37-bb32-37ef38ffa11a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:58:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquired lock "refresh_cache-059afcda-0cf1-4d37-bb32-37ef38ffa11a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:58:38 user nova-compute[74295]: DEBUG nova.network.neutron [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 06:58:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-bb203ebd-2670-4ae6-9b7b-eda3c7f21ca2 req-11dd77e9-8338-457a-a0f2-22464aaebd4a service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received event network-changed-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-bb203ebd-2670-4ae6-9b7b-eda3c7f21ca2 req-11dd77e9-8338-457a-a0f2-22464aaebd4a service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Refreshing instance network info cache due to event network-changed-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:58:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bb203ebd-2670-4ae6-9b7b-eda3c7f21ca2 req-11dd77e9-8338-457a-a0f2-22464aaebd4a service nova] Acquiring lock "refresh_cache-059afcda-0cf1-4d37-bb32-37ef38ffa11a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:58:38 user nova-compute[74295]: DEBUG nova.network.neutron [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.network.neutron [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Updating instance_info_cache with network_info: [{"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Releasing lock "refresh_cache-059afcda-0cf1-4d37-bb32-37ef38ffa11a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Instance network_info: |[{"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bb203ebd-2670-4ae6-9b7b-eda3c7f21ca2 req-11dd77e9-8338-457a-a0f2-22464aaebd4a service nova] Acquired lock "refresh_cache-059afcda-0cf1-4d37-bb32-37ef38ffa11a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.network.neutron [req-bb203ebd-2670-4ae6-9b7b-eda3c7f21ca2 req-11dd77e9-8338-457a-a0f2-22464aaebd4a service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Refreshing network info cache for port fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Start _get_guest_xml network_info=[{"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 06:58:39 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:58:39 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-785439478',display_name='tempest-VolumesNegativeTest-instance-785439478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-785439478',id=48,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ebd23fa6bec411bbfad6adafcf4fc4e',ramdisk_id='',reservation_id='r-zkfj5hmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-845909277',owner_user_name='tempest-VolumesNegativeTest-845909277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:58:37Z,user_data=None,user_id='fdc0231474384741af6d53678b7acdc0',uuid=059afcda-0cf1-4d37-bb32-37ef38ffa11a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Converting VIF {"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:f3:7c,bridge_name='br-int',has_traffic_filtering=True,id=fe63cbf8-3d1f-4ec8-afd8-b72e49f85212,network=Network(4109dc0f-169b-4464-a078-118192d7a0c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe63cbf8-3d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.objects.instance [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lazy-loading 'pci_devices' on Instance uuid 059afcda-0cf1-4d37-bb32-37ef38ffa11a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 06:58:39 user nova-compute[74295]:   <uuid>059afcda-0cf1-4d37-bb32-37ef38ffa11a</uuid>
Oct 26 06:58:39 user nova-compute[74295]:   <name>instance-00000030</name>
Oct 26 06:58:39 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 06:58:39 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 06:58:39 user nova-compute[74295]:   <metadata>
Oct 26 06:58:39 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 06:58:39 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 06:58:39 user nova-compute[74295]:       <nova:name>tempest-VolumesNegativeTest-instance-785439478</nova:name>
Oct 26 06:58:39 user nova-compute[74295]:       <nova:creationTime>2023-10-26 06:58:39</nova:creationTime>
Oct 26 06:58:39 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 06:58:39 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 06:58:39 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 06:58:39 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 06:58:39 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 06:58:39 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 06:58:39 user nova-compute[74295]:       </nova:flavor>
Oct 26 06:58:39 user nova-compute[74295]:       <nova:owner>
Oct 26 06:58:39 user nova-compute[74295]:         <nova:user uuid="fdc0231474384741af6d53678b7acdc0">tempest-VolumesNegativeTest-845909277-project-member</nova:user>
Oct 26 06:58:39 user nova-compute[74295]:         <nova:project uuid="8ebd23fa6bec411bbfad6adafcf4fc4e">tempest-VolumesNegativeTest-845909277</nova:project>
Oct 26 06:58:39 user nova-compute[74295]:       </nova:owner>
Oct 26 06:58:39 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 06:58:39 user nova-compute[74295]:       <nova:ports>
Oct 26 06:58:39 user nova-compute[74295]:         <nova:port uuid="fe63cbf8-3d1f-4ec8-afd8-b72e49f85212">
Oct 26 06:58:39 user nova-compute[74295]:           <nova:ip type="fixed" address="192.168.233.59" ipVersion="4"/>
Oct 26 06:58:39 user nova-compute[74295]:         </nova:port>
Oct 26 06:58:39 user nova-compute[74295]:       </nova:ports>
Oct 26 06:58:39 user nova-compute[74295]:     </nova:instance>
Oct 26 06:58:39 user nova-compute[74295]:   </metadata>
Oct 26 06:58:39 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 06:58:39 user nova-compute[74295]:     <system>
Oct 26 06:58:39 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 06:58:39 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 06:58:39 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 06:58:39 user nova-compute[74295]:       <entry name="serial">059afcda-0cf1-4d37-bb32-37ef38ffa11a</entry>
Oct 26 06:58:39 user nova-compute[74295]:       <entry name="uuid">059afcda-0cf1-4d37-bb32-37ef38ffa11a</entry>
Oct 26 06:58:39 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 06:58:39 user nova-compute[74295]:     </system>
Oct 26 06:58:39 user nova-compute[74295]:   </sysinfo>
Oct 26 06:58:39 user nova-compute[74295]:   <os>
Oct 26 06:58:39 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 06:58:39 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 06:58:39 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 06:58:39 user nova-compute[74295]:   </os>
Oct 26 06:58:39 user nova-compute[74295]:   <features>
Oct 26 06:58:39 user nova-compute[74295]:     <acpi/>
Oct 26 06:58:39 user nova-compute[74295]:     <apic/>
Oct 26 06:58:39 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 06:58:39 user nova-compute[74295]:   </features>
Oct 26 06:58:39 user nova-compute[74295]:   <clock offset="utc">
Oct 26 06:58:39 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 06:58:39 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 06:58:39 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 06:58:39 user nova-compute[74295]:   </clock>
Oct 26 06:58:39 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 06:58:39 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 06:58:39 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 06:58:39 user nova-compute[74295]:   </cpu>
Oct 26 06:58:39 user nova-compute[74295]:   <devices>
Oct 26 06:58:39 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 06:58:39 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 06:58:39 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk"/>
Oct 26 06:58:39 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 06:58:39 user nova-compute[74295]:     </disk>
Oct 26 06:58:39 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 06:58:39 user nova-compute[74295]:       <mac address="fa:16:3e:46:f3:7c"/>
Oct 26 06:58:39 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:58:39 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 06:58:39 user nova-compute[74295]:       <target dev="tapfe63cbf8-3d"/>
Oct 26 06:58:39 user nova-compute[74295]:     </interface>
Oct 26 06:58:39 user nova-compute[74295]:     <serial type="pty">
Oct 26 06:58:39 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/console.log" append="off"/>
Oct 26 06:58:39 user nova-compute[74295]:     </serial>
Oct 26 06:58:39 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 06:58:39 user nova-compute[74295]:     <video>
Oct 26 06:58:39 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 06:58:39 user nova-compute[74295]:     </video>
Oct 26 06:58:39 user nova-compute[74295]:     <rng model="virtio">
Oct 26 06:58:39 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 06:58:39 user nova-compute[74295]:     </rng>
Oct 26 06:58:39 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 06:58:39 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 06:58:39 user nova-compute[74295]:       <stats period="10"/>
Oct 26 06:58:39 user nova-compute[74295]:     </memballoon>
Oct 26 06:58:39 user nova-compute[74295]:   </devices>
Oct 26 06:58:39 user nova-compute[74295]: </domain>
Oct 26 06:58:39 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-785439478',display_name='tempest-VolumesNegativeTest-instance-785439478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-785439478',id=48,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ebd23fa6bec411bbfad6adafcf4fc4e',ramdisk_id='',reservation_id='r-zkfj5hmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-845909277',owner_user_name='tempest-VolumesNegativeTest-845909277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T06:58:37Z,user_data=None,user_id='fdc0231474384741af6d53678b7acdc0',uuid=059afcda-0cf1-4d37-bb32-37ef38ffa11a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Converting VIF {"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:f3:7c,bridge_name='br-int',has_traffic_filtering=True,id=fe63cbf8-3d1f-4ec8-afd8-b72e49f85212,network=Network(4109dc0f-169b-4464-a078-118192d7a0c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe63cbf8-3d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG os_vif [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f3:7c,bridge_name='br-int',has_traffic_filtering=True,id=fe63cbf8-3d1f-4ec8-afd8-b72e49f85212,network=Network(4109dc0f-169b-4464-a078-118192d7a0c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe63cbf8-3d') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58c1a4d3-c755-590c-8d45-1df6dfc7f747', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe63cbf8-3d, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe63cbf8-3d, col_values=(('qos', UUID('a7baea67-8c3d-44a4-9f76-f280c0d89be9')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe63cbf8-3d, col_values=(('external_ids', {'iface-id': 'fe63cbf8-3d1f-4ec8-afd8-b72e49f85212', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:f3:7c', 'vm-uuid': '059afcda-0cf1-4d37-bb32-37ef38ffa11a'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:39 user nova-compute[74295]: INFO os_vif [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f3:7c,bridge_name='br-int',has_traffic_filtering=True,id=fe63cbf8-3d1f-4ec8-afd8-b72e49f85212,network=Network(4109dc0f-169b-4464-a078-118192d7a0c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe63cbf8-3d')
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] No VIF found with MAC fa:16:3e:46:f3:7c, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.network.neutron [req-bb203ebd-2670-4ae6-9b7b-eda3c7f21ca2 req-11dd77e9-8338-457a-a0f2-22464aaebd4a service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Updated VIF entry in instance network info cache for port fe63cbf8-3d1f-4ec8-afd8-b72e49f85212. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG nova.network.neutron [req-bb203ebd-2670-4ae6-9b7b-eda3c7f21ca2 req-11dd77e9-8338-457a-a0f2-22464aaebd4a service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Updating instance_info_cache with network_info: [{"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:58:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-bb203ebd-2670-4ae6-9b7b-eda3c7f21ca2 req-11dd77e9-8338-457a-a0f2-22464aaebd4a service nova] Releasing lock "refresh_cache-059afcda-0cf1-4d37-bb32-37ef38ffa11a" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:58:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-3a07bd57-507c-4e79-9d43-65f238aa47a9 req-36f13a8f-c85f-4f82-ab5a-b5b577f409ed service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received event network-vif-plugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3a07bd57-507c-4e79-9d43-65f238aa47a9 req-36f13a8f-c85f-4f82-ab5a-b5b577f409ed service nova] Acquiring lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3a07bd57-507c-4e79-9d43-65f238aa47a9 req-36f13a8f-c85f-4f82-ab5a-b5b577f409ed service nova] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-3a07bd57-507c-4e79-9d43-65f238aa47a9 req-36f13a8f-c85f-4f82-ab5a-b5b577f409ed service nova] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:41 user nova-compute[74295]: DEBUG nova.compute.manager [req-3a07bd57-507c-4e79-9d43-65f238aa47a9 req-36f13a8f-c85f-4f82-ab5a-b5b577f409ed service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] No waiting events found dispatching network-vif-plugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:58:41 user nova-compute[74295]: WARNING nova.compute.manager [req-3a07bd57-507c-4e79-9d43-65f238aa47a9 req-36f13a8f-c85f-4f82-ab5a-b5b577f409ed service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received unexpected event network-vif-plugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 for instance with vm_state building and task_state spawning.
Oct 26 06:58:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 06:58:42 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Instance spawned successfully.
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 06:58:42 user nova-compute[74295]: INFO nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Took 6.12 seconds to spawn the instance on the hypervisor.
Oct 26 06:58:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 06:58:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:43 user nova-compute[74295]: INFO nova.compute.manager [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Took 6.77 seconds to build instance.
Oct 26 06:58:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-d431297c-ea25-4102-a2d6-dc5368bd2193 tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.878s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-06a3acbf-2d48-4e25-83f5-154f448a6698 req-202d71b4-99b8-43d3-a963-9607c110c2c5 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received event network-vif-plugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:58:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-06a3acbf-2d48-4e25-83f5-154f448a6698 req-202d71b4-99b8-43d3-a963-9607c110c2c5 service nova] Acquiring lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:58:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-06a3acbf-2d48-4e25-83f5-154f448a6698 req-202d71b4-99b8-43d3-a963-9607c110c2c5 service nova] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:58:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-06a3acbf-2d48-4e25-83f5-154f448a6698 req-202d71b4-99b8-43d3-a963-9607c110c2c5 service nova] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:58:43 user nova-compute[74295]: DEBUG nova.compute.manager [req-06a3acbf-2d48-4e25-83f5-154f448a6698 req-202d71b4-99b8-43d3-a963-9607c110c2c5 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] No waiting events found dispatching network-vif-plugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:58:43 user nova-compute[74295]: WARNING nova.compute.manager [req-06a3acbf-2d48-4e25-83f5-154f448a6698 req-202d71b4-99b8-43d3-a963-9607c110c2c5 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received unexpected event network-vif-plugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 for instance with vm_state active and task_state None.
Oct 26 06:58:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:49 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:58:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:58:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-883654b2-cc54-4279-b0cc-d4e73ee7bcd0 req-4d473979-8d02-4841-92de-29d0296f8f90 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received event network-changed-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-883654b2-cc54-4279-b0cc-d4e73ee7bcd0 req-4d473979-8d02-4841-92de-29d0296f8f90 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Refreshing instance network info cache due to event network-changed-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-883654b2-cc54-4279-b0cc-d4e73ee7bcd0 req-4d473979-8d02-4841-92de-29d0296f8f90 service nova] Acquiring lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-883654b2-cc54-4279-b0cc-d4e73ee7bcd0 req-4d473979-8d02-4841-92de-29d0296f8f90 service nova] Acquired lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG nova.network.neutron [req-883654b2-cc54-4279-b0cc-d4e73ee7bcd0 req-4d473979-8d02-4841-92de-29d0296f8f90 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Refreshing network info cache for port 88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "467bed28-02e4-439d-9b81-75831d638340" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "467bed28-02e4-439d-9b81-75831d638340" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "467bed28-02e4-439d-9b81-75831d638340-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "467bed28-02e4-439d-9b81-75831d638340-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "467bed28-02e4-439d-9b81-75831d638340-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:26 user nova-compute[74295]: INFO nova.compute.manager [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Terminating instance
Oct 26 06:59:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.network.neutron [req-883654b2-cc54-4279-b0cc-d4e73ee7bcd0 req-4d473979-8d02-4841-92de-29d0296f8f90 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updated VIF entry in instance network info cache for port 88f9bc45-5a84-4bf1-bd66-b4d425a49dbc. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.network.neutron [req-883654b2-cc54-4279-b0cc-d4e73ee7bcd0 req-4d473979-8d02-4841-92de-29d0296f8f90 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updating instance_info_cache with network_info: [{"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-883654b2-cc54-4279-b0cc-d4e73ee7bcd0 req-4d473979-8d02-4841-92de-29d0296f8f90 service nova] Releasing lock "refresh_cache-467bed28-02e4-439d-9b81-75831d638340" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.compute.manager [req-2b58a36e-004a-4990-8734-29c317412e6a req-356afa97-e448-4c6c-80f7-ede30f938ce9 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received event network-vif-unplugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2b58a36e-004a-4990-8734-29c317412e6a req-356afa97-e448-4c6c-80f7-ede30f938ce9 service nova] Acquiring lock "467bed28-02e4-439d-9b81-75831d638340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2b58a36e-004a-4990-8734-29c317412e6a req-356afa97-e448-4c6c-80f7-ede30f938ce9 service nova] Lock "467bed28-02e4-439d-9b81-75831d638340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-2b58a36e-004a-4990-8734-29c317412e6a req-356afa97-e448-4c6c-80f7-ede30f938ce9 service nova] Lock "467bed28-02e4-439d-9b81-75831d638340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.compute.manager [req-2b58a36e-004a-4990-8734-29c317412e6a req-356afa97-e448-4c6c-80f7-ede30f938ce9 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] No waiting events found dispatching network-vif-unplugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.compute.manager [req-2b58a36e-004a-4990-8734-29c317412e6a req-356afa97-e448-4c6c-80f7-ede30f938ce9 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received event network-vif-unplugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:59:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 467bed28-02e4-439d-9b81-75831d638340] Instance destroyed successfully.
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lazy-loading 'resources' on Instance uuid 467bed28-02e4-439d-9b81-75831d638340 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-278082241',display_name='tempest-TestVolumeBootPattern-server-278082241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-278082241',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO37LOfLGVLm8denc0aiOr8WCYx77Qraf7D47fN50S5LIaTBdJywjgiKJrg/08AIIVYLPW9NSG8sjHJOCwCiCGyrZMujB/2p5ls6F3JGSk5q17MYb1TgqAWMzwRKoYJlRg==',key_name='tempest-TestVolumeBootPattern-373663211',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:54:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75fe63ca1f244085963c38b864dff1db',ramdisk_id='',reservation_id='r-w9bq0b0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-594294549',owner_user_name='tempest-TestVolumeBootPattern-594294549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:54:16Z,user_data=None,user_id='11f8c68bbe2245c6b6f159c45e006216',uuid=467bed28-02e4-439d-9b81-75831d638340,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converting VIF {"id": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "address": "fa:16:3e:91:bd:91", "network": {"id": "9fd7503c-78aa-4924-bb56-0dc0a0e0ae72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1803693566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75fe63ca1f244085963c38b864dff1db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f9bc45-5a", "ovs_interfaceid": "88f9bc45-5a84-4bf1-bd66-b4d425a49dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:bd:91,bridge_name='br-int',has_traffic_filtering=True,id=88f9bc45-5a84-4bf1-bd66-b4d425a49dbc,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f9bc45-5a') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_vif [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:bd:91,bridge_name='br-int',has_traffic_filtering=True,id=88f9bc45-5a84-4bf1-bd66-b4d425a49dbc,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f9bc45-5a') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88f9bc45-5a, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba70ae8b-6495-45f4-b3bb-9cde7e3e0321) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:59:27 user nova-compute[74295]: INFO os_vif [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:bd:91,bridge_name='br-int',has_traffic_filtering=True,id=88f9bc45-5a84-4bf1-bd66-b4d425a49dbc,network=Network(9fd7503c-78aa-4924-bb56-0dc0a0e0ae72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f9bc45-5a')
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSYcHXpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 06:59:27 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[67acb298-e9cd-4edf-b59a-ba7377a5da5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 06:59:27 user nova-compute[74295]: No targets found.
Oct 26 06:59:27 user nova-compute[74295]: iSNS:
Oct 26 06:59:27 user nova-compute[74295]: No targets found.
Oct 26 06:59:27 user nova-compute[74295]: STATIC:
Oct 26 06:59:27 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be
Oct 26 06:59:27 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 06:59:27 user nova-compute[74295]:                 Iface Name: default
Oct 26 06:59:27 user nova-compute[74295]: FIRMWARE:
Oct 26 06:59:27 user nova-compute[74295]: No targets found.
Oct 26 06:59:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 06:59:27 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 06:59:27 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc6e471-2bb0-419d-912c-79a62fa66bc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdc3c1b-7eeb-4cad-8926-e709c4d00fdf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:59:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be (non-flash)
Oct 26 06:59:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35887c41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b250511-8681-4f79-baa3-66e179f3f786]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da6c937-227a-47e1-b136-7bc0365f0b5e]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4016c52-9f6b-4423-8125-8cab14eb9fcf]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.133s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fc6bca-ee86-424d-911b-a77f7223b9a8]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e95214-0c02-47d3-97e9-a54f18ffb3f2]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21f0ad6-be29-4586-a531-31f57089d732]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260]
Oct 26 06:59:27 user nova-compute[74295]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be, portal: 172.16.0.220,3260] successful.
Oct 26 06:59:27 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9fcdae4-3465-4086-9bf4-013fc1f2c5be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74f598e-62c8-4361-a58d-9a0976b75c58]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] <== disconnect_volume: return (398ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 06:59:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Deleting instance files /opt/stack/data/nova/instances/467bed28-02e4-439d-9b81-75831d638340_del
Oct 26 06:59:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Deletion of /opt/stack/data/nova/instances/467bed28-02e4-439d-9b81-75831d638340_del complete
Oct 26 06:59:27 user nova-compute[74295]: INFO nova.compute.manager [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 26 06:59:27 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 467bed28-02e4-439d-9b81-75831d638340] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:59:27 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 467bed28-02e4-439d-9b81-75831d638340] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:59:28 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 467bed28-02e4-439d-9b81-75831d638340] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:59:28 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 467bed28-02e4-439d-9b81-75831d638340] Took 0.48 seconds to deallocate network for instance.
Oct 26 06:59:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-197633a3-996f-43c2-bd25-9f0d09e2f1a9 req-fa2f0c3f-99db-4950-bf95-2ac6dcdf0358 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received event network-vif-deleted-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:59:29 user nova-compute[74295]: INFO nova.compute.manager [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] [instance: 467bed28-02e4-439d-9b81-75831d638340] Took 0.81 seconds to detach 1 volumes for instance.
Oct 26 06:59:29 user nova-compute[74295]: DEBUG nova.compute.manager [req-42f7a0a5-d696-407d-87de-278694988f4a req-d6aa34ef-f194-4fce-b71a-25c5e93f5516 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received event network-vif-plugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:59:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-42f7a0a5-d696-407d-87de-278694988f4a req-d6aa34ef-f194-4fce-b71a-25c5e93f5516 service nova] Acquiring lock "467bed28-02e4-439d-9b81-75831d638340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-42f7a0a5-d696-407d-87de-278694988f4a req-d6aa34ef-f194-4fce-b71a-25c5e93f5516 service nova] Lock "467bed28-02e4-439d-9b81-75831d638340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-42f7a0a5-d696-407d-87de-278694988f4a req-d6aa34ef-f194-4fce-b71a-25c5e93f5516 service nova] Lock "467bed28-02e4-439d-9b81-75831d638340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:29 user nova-compute[74295]: DEBUG nova.compute.manager [req-42f7a0a5-d696-407d-87de-278694988f4a req-d6aa34ef-f194-4fce-b71a-25c5e93f5516 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] No waiting events found dispatching network-vif-plugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:59:29 user nova-compute[74295]: WARNING nova.compute.manager [req-42f7a0a5-d696-407d-87de-278694988f4a req-d6aa34ef-f194-4fce-b71a-25c5e93f5516 service nova] [instance: 467bed28-02e4-439d-9b81-75831d638340] Received unexpected event network-vif-plugged-88f9bc45-5a84-4bf1-bd66-b4d425a49dbc for instance with vm_state active and task_state deleting.
Oct 26 06:59:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:29 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:59:29 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:59:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:29 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Deleted allocations for instance 467bed28-02e4-439d-9b81-75831d638340
Oct 26 06:59:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2d8b5b50-b11a-4f1d-9b2b-cf9e13ca5135 tempest-TestVolumeBootPattern-594294549 tempest-TestVolumeBootPattern-594294549-project-member] Lock "467bed28-02e4-439d-9b81-75831d638340" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.975s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:59:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:30 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 06:59:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 06:59:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 06:59:32 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:59:32 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 06:59:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8454MB free_disk=25.060043334960938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance a1a69164-d3a5-4531-a067-161923f10060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 5749e61b-a89c-4279-93db-56586f314c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 059afcda-0cf1-4d37-bb32-37ef38ffa11a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 06:59:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:33 user nova-compute[74295]: INFO nova.compute.manager [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Terminating instance
Oct 26 06:59:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 06:59:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-c3e9ec42-cdc8-40ee-88d6-97bc31c8352c req-1f4470cc-a0f1-4c4b-8a28-a823a8753b9c service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received event network-vif-unplugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c3e9ec42-cdc8-40ee-88d6-97bc31c8352c req-1f4470cc-a0f1-4c4b-8a28-a823a8753b9c service nova] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c3e9ec42-cdc8-40ee-88d6-97bc31c8352c req-1f4470cc-a0f1-4c4b-8a28-a823a8753b9c service nova] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c3e9ec42-cdc8-40ee-88d6-97bc31c8352c req-1f4470cc-a0f1-4c4b-8a28-a823a8753b9c service nova] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-c3e9ec42-cdc8-40ee-88d6-97bc31c8352c req-1f4470cc-a0f1-4c4b-8a28-a823a8753b9c service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] No waiting events found dispatching network-vif-unplugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-c3e9ec42-cdc8-40ee-88d6-97bc31c8352c req-1f4470cc-a0f1-4c4b-8a28-a823a8753b9c service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received event network-vif-unplugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:59:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: a1a69164-d3a5-4531-a067-161923f10060] Instance destroyed successfully.
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.objects.instance [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lazy-loading 'resources' on Instance uuid a1a69164-d3a5-4531-a067-161923f10060 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-19705181',display_name='tempest-SnapshotDataIntegrityTests-server-19705181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-19705181',id=41,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHefIF/6K5tCOMUX6OK6m87YtT5ClWFdWDsYhXu0QEt5bf2YfmS8t1gAotpnmApvWTEFuovnRhchpXAuGEgHjcocnxaQa7Gzisi5bA5SD+qeWa5oQCzIBRRFVRAsmjUzyQ==',key_name='tempest-keypair-681420892',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe89badcba2e4eb4bcede517fb56abdc',ramdisk_id='',reservation_id='r-hpdclowz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-422939938',owner_user_name='tempest-SnapshotDataIntegrityTests-422939938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75cbe23551274f56b849714907ec72b3',uuid=a1a69164-d3a5-4531-a067-161923f10060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Converting VIF {"id": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "address": "fa:16:3e:dd:27:97", "network": {"id": "71d309af-3e5d-4efb-8292-f8a7d884c69f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1789071594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe89badcba2e4eb4bcede517fb56abdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ace45a-5d", "ovs_interfaceid": "c1ace45a-5d04-4dd3-a5f9-f5c3256e951f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:27:97,bridge_name='br-int',has_traffic_filtering=True,id=c1ace45a-5d04-4dd3-a5f9-f5c3256e951f,network=Network(71d309af-3e5d-4efb-8292-f8a7d884c69f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace45a-5d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG os_vif [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:27:97,bridge_name='br-int',has_traffic_filtering=True,id=c1ace45a-5d04-4dd3-a5f9-f5c3256e951f,network=Network(71d309af-3e5d-4efb-8292-f8a7d884c69f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace45a-5d') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1ace45a-5d, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a12a9ebd-6d70-46bc-890a-a2582f14d40c) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:34 user nova-compute[74295]: INFO os_vif [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:27:97,bridge_name='br-int',has_traffic_filtering=True,id=c1ace45a-5d04-4dd3-a5f9-f5c3256e951f,network=Network(71d309af-3e5d-4efb-8292-f8a7d884c69f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ace45a-5d')
Oct 26 06:59:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Deleting instance files /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060_del
Oct 26 06:59:34 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Deletion of /opt/stack/data/nova/instances/a1a69164-d3a5-4531-a067-161923f10060_del complete
Oct 26 06:59:34 user nova-compute[74295]: INFO nova.compute.manager [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] [instance: a1a69164-d3a5-4531-a067-161923f10060] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 06:59:34 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: a1a69164-d3a5-4531-a067-161923f10060] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 06:59:34 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: a1a69164-d3a5-4531-a067-161923f10060] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: a1a69164-d3a5-4531-a067-161923f10060] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:59:35 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: a1a69164-d3a5-4531-a067-161923f10060] Took 0.81 seconds to deallocate network for instance.
Oct 26 06:59:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-146ae908-0c63-47bb-8e2f-ec55b85c4d88 req-c6f06f53-2af2-4729-9f46-7818b0689ea0 service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received event network-vif-deleted-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 06:59:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:35 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Deleted allocations for instance a1a69164-d3a5-4531-a067-161923f10060
Oct 26 06:59:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-78285482-dc13-455d-b1ff-c6acef7bdf31 tempest-SnapshotDataIntegrityTests-422939938 tempest-SnapshotDataIntegrityTests-422939938-project-member] Lock "a1a69164-d3a5-4531-a067-161923f10060" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.012s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-41a802cc-8dad-4ebe-aad6-2ae7edd9d445 req-249d0c58-acc1-41c5-81c2-308c6213324d service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received event network-vif-plugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 06:59:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-41a802cc-8dad-4ebe-aad6-2ae7edd9d445 req-249d0c58-acc1-41c5-81c2-308c6213324d service nova] Acquiring lock "a1a69164-d3a5-4531-a067-161923f10060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 06:59:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-41a802cc-8dad-4ebe-aad6-2ae7edd9d445 req-249d0c58-acc1-41c5-81c2-308c6213324d service nova] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 06:59:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-41a802cc-8dad-4ebe-aad6-2ae7edd9d445 req-249d0c58-acc1-41c5-81c2-308c6213324d service nova] Lock "a1a69164-d3a5-4531-a067-161923f10060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 06:59:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-41a802cc-8dad-4ebe-aad6-2ae7edd9d445 req-249d0c58-acc1-41c5-81c2-308c6213324d service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] No waiting events found dispatching network-vif-plugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 06:59:36 user nova-compute[74295]: WARNING nova.compute.manager [req-41a802cc-8dad-4ebe-aad6-2ae7edd9d445 req-249d0c58-acc1-41c5-81c2-308c6213324d service nova] [instance: a1a69164-d3a5-4531-a067-161923f10060] Received unexpected event network-vif-plugged-c1ace45a-5d04-4dd3-a5f9-f5c3256e951f for instance with vm_state deleted and task_state None.
Oct 26 06:59:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:59:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 06:59:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 06:59:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 06:59:36 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 06:59:37 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating instance_info_cache with network_info: [{"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 06:59:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-5749e61b-a89c-4279-93db-56586f314c4c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 06:59:37 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 06:59:38 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 06:59:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:59:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:59:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:59:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:59:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:59:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 06:59:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 06:59:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:59:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 06:59:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 06:59:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:03 user nova-compute[74295]: INFO nova.compute.manager [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Terminating instance
Oct 26 07:00:03 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-8596dc4f-82df-49d2-b4f6-becb63d91934 req-25a92685-f562-46e5-9ce0-89ad750143b1 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-unplugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8596dc4f-82df-49d2-b4f6-becb63d91934 req-25a92685-f562-46e5-9ce0-89ad750143b1 service nova] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8596dc4f-82df-49d2-b4f6-becb63d91934 req-25a92685-f562-46e5-9ce0-89ad750143b1 service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8596dc4f-82df-49d2-b4f6-becb63d91934 req-25a92685-f562-46e5-9ce0-89ad750143b1 service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-8596dc4f-82df-49d2-b4f6-becb63d91934 req-25a92685-f562-46e5-9ce0-89ad750143b1 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] No waiting events found dispatching network-vif-unplugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:00:03 user nova-compute[74295]: DEBUG nova.compute.manager [req-8596dc4f-82df-49d2-b4f6-becb63d91934 req-25a92685-f562-46e5-9ce0-89ad750143b1 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-unplugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:04 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Instance destroyed successfully.
Oct 26 07:00:04 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lazy-loading 'resources' on Instance uuid 5749e61b-a89c-4279-93db-56586f314c4c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T06:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1628253072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1628253072',id=46,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBHdg/Ng2JnVD3A+ZVC2yiJGHaG39oVppuiWnjfhemy4nwp0brDK+xBtnuqoM8+q4/fWy4ldBf8vD3rmVGELnr4tgj51nJ9TinQJUiTWxJMFKlM7clTV1tMHTQ9fgreOg==',key_name='tempest-keypair-1359324483',keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74a74a5d314a4075923b5c21b2c39097',ramdisk_id='',reservation_id='r-1540cl09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1252316399',owner_user_name='tempest-AttachVolumeShelveTestJSON-1252316399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ce2ec6aad1e4e068958bcc61d50cb73',uuid=5749e61b-a89c-4279-93db-56586f314c4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converting VIF {"id": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "address": "fa:16:3e:87:d8:08", "network": {"id": "e362c543-8cad-4ac6-96c6-9b7cf71670be", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988325541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a74a5d314a4075923b5c21b2c39097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec1cce7-30", "ovs_interfaceid": "eec1cce7-3079-4a81-80a5-019a4f7fa7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG os_vif [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeec1cce7-30, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=121624f6-68ba-4a76-838b-8c7d7ec9e5b8) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:00:04 user nova-compute[74295]: INFO os_vif [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:d8:08,bridge_name='br-int',has_traffic_filtering=True,id=eec1cce7-3079-4a81-80a5-019a4f7fa7eb,network=Network(e362c543-8cad-4ac6-96c6-9b7cf71670be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec1cce7-30')
Oct 26 07:00:04 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Deleting instance files /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c_del
Oct 26 07:00:04 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Deletion of /opt/stack/data/nova/instances/5749e61b-a89c-4279-93db-56586f314c4c_del complete
Oct 26 07:00:04 user nova-compute[74295]: INFO nova.compute.manager [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 07:00:04 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:04 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:00:05 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Took 0.83 seconds to deallocate network for instance.
Oct 26 07:00:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-1b5adb3e-d423-4b8e-93ad-02a720256cc1 req-f2707c1b-3a02-45bf-880b-f28fb9f7ac1b service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-deleted-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:05 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Deleted allocations for instance 5749e61b-a89c-4279-93db-56586f314c4c
Oct 26 07:00:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6f829635-b24d-4218-bf74-67c248fc88e1 tempest-AttachVolumeShelveTestJSON-1252316399 tempest-AttachVolumeShelveTestJSON-1252316399-project-member] Lock "5749e61b-a89c-4279-93db-56586f314c4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-9dcecdff-12b9-405b-b2c7-b78c84c1e786 req-fd96fe9d-7506-4aa1-a9a9-5febcbdd1653 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9dcecdff-12b9-405b-b2c7-b78c84c1e786 req-fd96fe9d-7506-4aa1-a9a9-5febcbdd1653 service nova] Acquiring lock "5749e61b-a89c-4279-93db-56586f314c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9dcecdff-12b9-405b-b2c7-b78c84c1e786 req-fd96fe9d-7506-4aa1-a9a9-5febcbdd1653 service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9dcecdff-12b9-405b-b2c7-b78c84c1e786 req-fd96fe9d-7506-4aa1-a9a9-5febcbdd1653 service nova] Lock "5749e61b-a89c-4279-93db-56586f314c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:05 user nova-compute[74295]: DEBUG nova.compute.manager [req-9dcecdff-12b9-405b-b2c7-b78c84c1e786 req-fd96fe9d-7506-4aa1-a9a9-5febcbdd1653 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] No waiting events found dispatching network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:00:05 user nova-compute[74295]: WARNING nova.compute.manager [req-9dcecdff-12b9-405b-b2c7-b78c84c1e786 req-fd96fe9d-7506-4aa1-a9a9-5febcbdd1653 service nova] [instance: 5749e61b-a89c-4279-93db-56586f314c4c] Received unexpected event network-vif-plugged-eec1cce7-3079-4a81-80a5-019a4f7fa7eb for instance with vm_state deleted and task_state None.
Oct 26 07:00:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:00:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:00:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:00:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:00:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:00:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquiring lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquiring lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:26 user nova-compute[74295]: INFO nova.compute.manager [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Terminating instance
Oct 26 07:00:26 user nova-compute[74295]: DEBUG nova.compute.manager [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-0754ec63-63ea-4db6-bb91-e3cf23c3d14c req-334e9ce3-33ac-415b-b100-5a7a6af6d0a7 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received event network-vif-unplugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0754ec63-63ea-4db6-bb91-e3cf23c3d14c req-334e9ce3-33ac-415b-b100-5a7a6af6d0a7 service nova] Acquiring lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0754ec63-63ea-4db6-bb91-e3cf23c3d14c req-334e9ce3-33ac-415b-b100-5a7a6af6d0a7 service nova] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0754ec63-63ea-4db6-bb91-e3cf23c3d14c req-334e9ce3-33ac-415b-b100-5a7a6af6d0a7 service nova] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-0754ec63-63ea-4db6-bb91-e3cf23c3d14c req-334e9ce3-33ac-415b-b100-5a7a6af6d0a7 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] No waiting events found dispatching network-vif-unplugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:00:26 user nova-compute[74295]: DEBUG nova.compute.manager [req-0754ec63-63ea-4db6-bb91-e3cf23c3d14c req-334e9ce3-33ac-415b-b100-5a7a6af6d0a7 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received event network-vif-unplugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 07:00:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Instance destroyed successfully.
Oct 26 07:00:27 user nova-compute[74295]: DEBUG nova.objects.instance [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lazy-loading 'resources' on Instance uuid 059afcda-0cf1-4d37-bb32-37ef38ffa11a {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T06:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-785439478',display_name='tempest-VolumesNegativeTest-instance-785439478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-785439478',id=48,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T06:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ebd23fa6bec411bbfad6adafcf4fc4e',ramdisk_id='',reservation_id='r-zkfj5hmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-845909277',owner_user_name='tempest-VolumesNegativeTest-845909277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T06:58:43Z,user_data=None,user_id='fdc0231474384741af6d53678b7acdc0',uuid=059afcda-0cf1-4d37-bb32-37ef38ffa11a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Converting VIF {"id": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "address": "fa:16:3e:46:f3:7c", "network": {"id": "4109dc0f-169b-4464-a078-118192d7a0c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3f29a24ad5e242c28bfe355ce6dec8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe63cbf8-3d", "ovs_interfaceid": "fe63cbf8-3d1f-4ec8-afd8-b72e49f85212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:f3:7c,bridge_name='br-int',has_traffic_filtering=True,id=fe63cbf8-3d1f-4ec8-afd8-b72e49f85212,network=Network(4109dc0f-169b-4464-a078-118192d7a0c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe63cbf8-3d') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG os_vif [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f3:7c,bridge_name='br-int',has_traffic_filtering=True,id=fe63cbf8-3d1f-4ec8-afd8-b72e49f85212,network=Network(4109dc0f-169b-4464-a078-118192d7a0c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe63cbf8-3d') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe63cbf8-3d, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7baea67-8c3d-44a4-9f76-f280c0d89be9) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:00:27 user nova-compute[74295]: INFO os_vif [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:f3:7c,bridge_name='br-int',has_traffic_filtering=True,id=fe63cbf8-3d1f-4ec8-afd8-b72e49f85212,network=Network(4109dc0f-169b-4464-a078-118192d7a0c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe63cbf8-3d')
Oct 26 07:00:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Deleting instance files /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a_del
Oct 26 07:00:27 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Deletion of /opt/stack/data/nova/instances/059afcda-0cf1-4d37-bb32-37ef38ffa11a_del complete
Oct 26 07:00:27 user nova-compute[74295]: INFO nova.compute.manager [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 26 07:00:27 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:00:27 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Took 0.56 seconds to deallocate network for instance.
Oct 26 07:00:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:00:27 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:00:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:28 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Deleted allocations for instance 059afcda-0cf1-4d37-bb32-37ef38ffa11a
Oct 26 07:00:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-c24ab7c3-775e-41ec-8483-b33d3a87391f tempest-VolumesNegativeTest-845909277 tempest-VolumesNegativeTest-845909277-project-member] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.597s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:28 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-cc2fb509-add9-4ed0-b85a-b4a1ba832842 req-82f892d2-6c2b-413b-8852-5d6fece958e2 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received event network-vif-plugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:00:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cc2fb509-add9-4ed0-b85a-b4a1ba832842 req-82f892d2-6c2b-413b-8852-5d6fece958e2 service nova] Acquiring lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cc2fb509-add9-4ed0-b85a-b4a1ba832842 req-82f892d2-6c2b-413b-8852-5d6fece958e2 service nova] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-cc2fb509-add9-4ed0-b85a-b4a1ba832842 req-82f892d2-6c2b-413b-8852-5d6fece958e2 service nova] Lock "059afcda-0cf1-4d37-bb32-37ef38ffa11a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-cc2fb509-add9-4ed0-b85a-b4a1ba832842 req-82f892d2-6c2b-413b-8852-5d6fece958e2 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] No waiting events found dispatching network-vif-plugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:00:28 user nova-compute[74295]: WARNING nova.compute.manager [req-cc2fb509-add9-4ed0-b85a-b4a1ba832842 req-82f892d2-6c2b-413b-8852-5d6fece958e2 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received unexpected event network-vif-plugged-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 for instance with vm_state deleted and task_state None.
Oct 26 07:00:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-cc2fb509-add9-4ed0-b85a-b4a1ba832842 req-82f892d2-6c2b-413b-8852-5d6fece958e2 service nova] [instance: 059afcda-0cf1-4d37-bb32-37ef38ffa11a] Received event network-vif-deleted-fe63cbf8-3d1f-4ec8-afd8-b72e49f85212 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:00:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:30 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:00:31 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:00:31 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:00:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8870MB free_disk=25.141033172607422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:00:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:00:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:00:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:00:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:00:31 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:00:31 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:00:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:00:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:00:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:35 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:00:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:00:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:00:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 07:00:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:00:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:00:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:01:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:01:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:26 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:31 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:01:32 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:01:32 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:01:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=25.1292724609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:01:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:01:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:01:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:01:32 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:01:32 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:01:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:01:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:01:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:37 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:37 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:01:37 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:01:37 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 07:01:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:42 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 07:01:45 user nova-compute[74295]: INFO nova.compute.claims [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Claim successful on node user
Oct 26 07:01:45 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 07:01:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 07:01:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 07:01:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 07:01:46 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Creating image(s)
Oct 26 07:01:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "/opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "/opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "/opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.112s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "62d42c02e95b128ce1c5a420682a5e69f871c211" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "62d42c02e95b128ce1c5a420682a5e69f871c211" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG nova.policy [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f57b2d2a359e42f6916e19d83c33ad99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8ca02ae7f949259a2709a5ffa98852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Successfully created port: 93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG nova.virt.images [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] e930dac7-088b-424c-9354-ebc0f2dcfc7c was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 07:01:46 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211.part /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211.part /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211.converted" returned: 0 in 0.250s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "62d42c02e95b128ce1c5a420682a5e69f871c211" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.167s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG nova.network.neutron [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Successfully updated port: 93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG nova.network.neutron [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b475ea6-1956-4594-8edb-f287027339f9 req-29bae87c-ab95-4db7-8f2c-f9a14e23db79 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG nova.compute.manager [req-9b475ea6-1956-4594-8edb-f287027339f9 req-29bae87c-ab95-4db7-8f2c-f9a14e23db79 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing instance network info cache due to event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b475ea6-1956-4594-8edb-f287027339f9 req-29bae87c-ab95-4db7-8f2c-f9a14e23db79 service nova] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211 --force-share --output=json" returned: 0 in 0.182s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "62d42c02e95b128ce1c5a420682a5e69f871c211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "62d42c02e95b128ce1c5a420682a5e69f871c211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG nova.network.neutron [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211 --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211,backing_fmt=raw /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211,backing_fmt=raw /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk 1073741824" returned: 0 in 0.045s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "62d42c02e95b128ce1c5a420682a5e69f871c211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG nova.network.neutron [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Instance network_info: |[{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b475ea6-1956-4594-8edb-f287027339f9 req-29bae87c-ab95-4db7-8f2c-f9a14e23db79 service nova] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:01:47 user nova-compute[74295]: DEBUG nova.network.neutron [req-9b475ea6-1956-4594-8edb-f287027339f9 req-29bae87c-ab95-4db7-8f2c-f9a14e23db79 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211 --force-share --output=json" returned: 0 in 0.209s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Cannot resize image /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Ensure instance console log exists: /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Start _get_guest_xml network_info=[{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T07:01:43Z,direct_url=<?>,disk_format='qcow2',id=e930dac7-088b-424c-9354-ebc0f2dcfc7c,min_disk=0,min_ram=0,name='tempest-scenario-img--265707758',owner='7c8ca02ae7f949259a2709a5ffa98852',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T07:01:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'e930dac7-088b-424c-9354-ebc0f2dcfc7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 07:01:48 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:01:48 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T07:01:43Z,direct_url=<?>,disk_format='qcow2',id=e930dac7-088b-424c-9354-ebc0f2dcfc7c,min_disk=0,min_ram=0,name='tempest-scenario-img--265707758',owner='7c8ca02ae7f949259a2709a5ffa98852',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T07:01:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1914782709',display_name='tempest-TestMinimumBasicScenario-server-1914782709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1914782709',id=49,image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaRv8ANlSgUHRv/nDFHs+nItRh5zcQgCRgEh547YsGttZ22djFF9IjemxGCQTDPSDlFbSXA7hynslyggfdgBwK8c/9GXMIVS47JSmUnhO95iu+++L6Z8ZML/rg7rzYPkA==',key_name='tempest-TestMinimumBasicScenario-1113082317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8ca02ae7f949259a2709a5ffa98852',ramdisk_id='',reservation_id='r-q1ufesh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-230365205',owner_user_name='tempest-TestMinimumBasicScenario-230365205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T07:01:46Z,user_data=None,user_id='f57b2d2a359e42f6916e19d83c33ad99',uuid=69fc86e9-940c-4908-bf93-1d5453012c5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converting VIF {"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.objects.instance [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'pci_devices' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.network.neutron [req-9b475ea6-1956-4594-8edb-f287027339f9 req-29bae87c-ab95-4db7-8f2c-f9a14e23db79 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updated VIF entry in instance network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.network.neutron [req-9b475ea6-1956-4594-8edb-f287027339f9 req-29bae87c-ab95-4db7-8f2c-f9a14e23db79 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 07:01:48 user nova-compute[74295]:   <uuid>69fc86e9-940c-4908-bf93-1d5453012c5c</uuid>
Oct 26 07:01:48 user nova-compute[74295]:   <name>instance-00000031</name>
Oct 26 07:01:48 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 07:01:48 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 07:01:48 user nova-compute[74295]:   <metadata>
Oct 26 07:01:48 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 07:01:48 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 07:01:48 user nova-compute[74295]:       <nova:name>tempest-TestMinimumBasicScenario-server-1914782709</nova:name>
Oct 26 07:01:48 user nova-compute[74295]:       <nova:creationTime>2023-10-26 07:01:48</nova:creationTime>
Oct 26 07:01:48 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 07:01:48 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 07:01:48 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 07:01:48 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 07:01:48 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 07:01:48 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 07:01:48 user nova-compute[74295]:       </nova:flavor>
Oct 26 07:01:48 user nova-compute[74295]:       <nova:owner>
Oct 26 07:01:48 user nova-compute[74295]:         <nova:user uuid="f57b2d2a359e42f6916e19d83c33ad99">tempest-TestMinimumBasicScenario-230365205-project-member</nova:user>
Oct 26 07:01:48 user nova-compute[74295]:         <nova:project uuid="7c8ca02ae7f949259a2709a5ffa98852">tempest-TestMinimumBasicScenario-230365205</nova:project>
Oct 26 07:01:48 user nova-compute[74295]:       </nova:owner>
Oct 26 07:01:48 user nova-compute[74295]:       <nova:root type="image" uuid="e930dac7-088b-424c-9354-ebc0f2dcfc7c"/>
Oct 26 07:01:48 user nova-compute[74295]:       <nova:ports>
Oct 26 07:01:48 user nova-compute[74295]:         <nova:port uuid="93f8fb4b-a09f-4444-8389-3f3efa7dec33">
Oct 26 07:01:48 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 07:01:48 user nova-compute[74295]:         </nova:port>
Oct 26 07:01:48 user nova-compute[74295]:       </nova:ports>
Oct 26 07:01:48 user nova-compute[74295]:     </nova:instance>
Oct 26 07:01:48 user nova-compute[74295]:   </metadata>
Oct 26 07:01:48 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 07:01:48 user nova-compute[74295]:     <system>
Oct 26 07:01:48 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 07:01:48 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 07:01:48 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 07:01:48 user nova-compute[74295]:       <entry name="serial">69fc86e9-940c-4908-bf93-1d5453012c5c</entry>
Oct 26 07:01:48 user nova-compute[74295]:       <entry name="uuid">69fc86e9-940c-4908-bf93-1d5453012c5c</entry>
Oct 26 07:01:48 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 07:01:48 user nova-compute[74295]:     </system>
Oct 26 07:01:48 user nova-compute[74295]:   </sysinfo>
Oct 26 07:01:48 user nova-compute[74295]:   <os>
Oct 26 07:01:48 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 07:01:48 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 07:01:48 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 07:01:48 user nova-compute[74295]:   </os>
Oct 26 07:01:48 user nova-compute[74295]:   <features>
Oct 26 07:01:48 user nova-compute[74295]:     <acpi/>
Oct 26 07:01:48 user nova-compute[74295]:     <apic/>
Oct 26 07:01:48 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 07:01:48 user nova-compute[74295]:   </features>
Oct 26 07:01:48 user nova-compute[74295]:   <clock offset="utc">
Oct 26 07:01:48 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 07:01:48 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 07:01:48 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 07:01:48 user nova-compute[74295]:   </clock>
Oct 26 07:01:48 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 07:01:48 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 07:01:48 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 07:01:48 user nova-compute[74295]:   </cpu>
Oct 26 07:01:48 user nova-compute[74295]:   <devices>
Oct 26 07:01:48 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 07:01:48 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 07:01:48 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk"/>
Oct 26 07:01:48 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 07:01:48 user nova-compute[74295]:     </disk>
Oct 26 07:01:48 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 07:01:48 user nova-compute[74295]:       <mac address="fa:16:3e:22:8c:bc"/>
Oct 26 07:01:48 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:01:48 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 07:01:48 user nova-compute[74295]:       <target dev="tap93f8fb4b-a0"/>
Oct 26 07:01:48 user nova-compute[74295]:     </interface>
Oct 26 07:01:48 user nova-compute[74295]:     <serial type="pty">
Oct 26 07:01:48 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/console.log" append="off"/>
Oct 26 07:01:48 user nova-compute[74295]:     </serial>
Oct 26 07:01:48 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 07:01:48 user nova-compute[74295]:     <video>
Oct 26 07:01:48 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:01:48 user nova-compute[74295]:     </video>
Oct 26 07:01:48 user nova-compute[74295]:     <rng model="virtio">
Oct 26 07:01:48 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 07:01:48 user nova-compute[74295]:     </rng>
Oct 26 07:01:48 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 07:01:48 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 07:01:48 user nova-compute[74295]:       <stats period="10"/>
Oct 26 07:01:48 user nova-compute[74295]:     </memballoon>
Oct 26 07:01:48 user nova-compute[74295]:   </devices>
Oct 26 07:01:48 user nova-compute[74295]: </domain>
Oct 26 07:01:48 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1914782709',display_name='tempest-TestMinimumBasicScenario-server-1914782709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1914782709',id=49,image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaRv8ANlSgUHRv/nDFHs+nItRh5zcQgCRgEh547YsGttZ22djFF9IjemxGCQTDPSDlFbSXA7hynslyggfdgBwK8c/9GXMIVS47JSmUnhO95iu+++L6Z8ZML/rg7rzYPkA==',key_name='tempest-TestMinimumBasicScenario-1113082317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8ca02ae7f949259a2709a5ffa98852',ramdisk_id='',reservation_id='r-q1ufesh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-230365205',owner_user_name='tempest-TestMinimumBasicScenario-230365205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T07:01:46Z,user_data=None,user_id='f57b2d2a359e42f6916e19d83c33ad99',uuid=69fc86e9-940c-4908-bf93-1d5453012c5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converting VIF {"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG os_vif [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9b475ea6-1956-4594-8edb-f287027339f9 req-29bae87c-ab95-4db7-8f2c-f9a14e23db79 service nova] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfe3dc41-1d9d-5a7f-870d-d6edab63286a', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93f8fb4b-a0, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93f8fb4b-a0, col_values=(('qos', UUID('ccb19e4d-89c5-4d9b-85fd-eea925b7d8ba')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93f8fb4b-a0, col_values=(('external_ids', {'iface-id': '93f8fb4b-a09f-4444-8389-3f3efa7dec33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:8c:bc', 'vm-uuid': '69fc86e9-940c-4908-bf93-1d5453012c5c'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:48 user nova-compute[74295]: INFO os_vif [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0')
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 07:01:48 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No VIF found with MAC fa:16:3e:22:8c:bc, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 07:01:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-0573c8ad-bacf-42b9-b3be-e5658eaa3ae6 req-caf476c4-22a0-471b-9728-ea78f3448247 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:01:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0573c8ad-bacf-42b9-b3be-e5658eaa3ae6 req-caf476c4-22a0-471b-9728-ea78f3448247 service nova] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0573c8ad-bacf-42b9-b3be-e5658eaa3ae6 req-caf476c4-22a0-471b-9728-ea78f3448247 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-0573c8ad-bacf-42b9-b3be-e5658eaa3ae6 req-caf476c4-22a0-471b-9728-ea78f3448247 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:50 user nova-compute[74295]: DEBUG nova.compute.manager [req-0573c8ad-bacf-42b9-b3be-e5658eaa3ae6 req-caf476c4-22a0-471b-9728-ea78f3448247 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] No waiting events found dispatching network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:01:50 user nova-compute[74295]: WARNING nova.compute.manager [req-0573c8ad-bacf-42b9-b3be-e5658eaa3ae6 req-caf476c4-22a0-471b-9728-ea78f3448247 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received unexpected event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 for instance with vm_state building and task_state spawning.
Oct 26 07:01:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 07:01:52 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Instance spawned successfully.
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-258fe903-a462-4725-978c-ee540bacb117 req-6c57c8f8-ee05-46da-a45e-c632876319d4 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-258fe903-a462-4725-978c-ee540bacb117 req-6c57c8f8-ee05-46da-a45e-c632876319d4 service nova] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-258fe903-a462-4725-978c-ee540bacb117 req-6c57c8f8-ee05-46da-a45e-c632876319d4 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-258fe903-a462-4725-978c-ee540bacb117 req-6c57c8f8-ee05-46da-a45e-c632876319d4 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-258fe903-a462-4725-978c-ee540bacb117 req-6c57c8f8-ee05-46da-a45e-c632876319d4 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] No waiting events found dispatching network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:01:52 user nova-compute[74295]: WARNING nova.compute.manager [req-258fe903-a462-4725-978c-ee540bacb117 req-6c57c8f8-ee05-46da-a45e-c632876319d4 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received unexpected event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 for instance with vm_state building and task_state spawning.
Oct 26 07:01:52 user nova-compute[74295]: INFO nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 26 07:01:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 07:01:52 user nova-compute[74295]: INFO nova.compute.manager [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Took 6.67 seconds to build instance.
Oct 26 07:01:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-7e8f07a2-032a-4b8b-858e-1dc9cacbf9f8 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.770s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Verify base images {{(pid=74295) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Image id e930dac7-088b-424c-9354-ebc0f2dcfc7c yields fingerprint 62d42c02e95b128ce1c5a420682a5e69f871c211 {{(pid=74295) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] image e930dac7-088b-424c-9354-ebc0f2dcfc7c at (/opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211): checking
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] image e930dac7-088b-424c-9354-ebc0f2dcfc7c at (/opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211): image is in use {{(pid=74295) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74295) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] 69fc86e9-940c-4908-bf93-1d5453012c5c is a valid instance name {{(pid=74295) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] 69fc86e9-940c-4908-bf93-1d5453012c5c has a disk file {{(pid=74295) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 69fc86e9-940c-4908-bf93-1d5453012c5c is backed by 62d42c02e95b128ce1c5a420682a5e69f871c211 {{(pid=74295) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 26 07:01:55 user nova-compute[74295]: WARNING nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5
Oct 26 07:01:55 user nova-compute[74295]: WARNING nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Unknown base file: /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd
Oct 26 07:01:55 user nova-compute[74295]: WARNING nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Unknown base file: /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83
Oct 26 07:01:55 user nova-compute[74295]: WARNING nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622
Oct 26 07:01:55 user nova-compute[74295]: WARNING nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Unknown base file: /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947
Oct 26 07:01:55 user nova-compute[74295]: WARNING nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Unknown base file: /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc
Oct 26 07:01:55 user nova-compute[74295]: WARNING nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Unknown base file: /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799
Oct 26 07:01:55 user nova-compute[74295]: WARNING nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Unknown base file: /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Active base files: /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Removable base files: /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5 /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83 /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622 /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947 /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f7ae3f0ca691b982d297c706213824ed37501f5
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/27c8b41440e4ab14ba1c48d1ea12fff703cbb9cd
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3e9ad31671f8ab22d035f33072814d0241e0dd83
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f126925d6c2d825cb907c20c7eef5c9b677d622
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/feb1bf699456465ab613bf79c2110ef3c47b0947
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/72576aff223934b109489db4ce70a1c5a0adf0cc
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799
Oct 26 07:01:55 user nova-compute[74295]: INFO nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/85a0f8e5c6310c39f76232f8d91e5918c6f4276a
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Verification complete {{(pid=74295) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Verify swap images {{(pid=74295) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 26 07:01:55 user nova-compute[74295]: DEBUG nova.virt.libvirt.imagecache [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Verify ephemeral images {{(pid=74295) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 26 07:01:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:01:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:02:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:02:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:02:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:27 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:32 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:02:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:02:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:02:32 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:02:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:02:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:02:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:33 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:02:33 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:02:33 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8876MB free_disk=25.03665542602539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 69fc86e9-940c-4908-bf93-1d5453012c5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 07:02:33 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 07:02:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:02:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:36 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 07:02:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:02:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:02:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:02:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:02:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:02:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:02:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:02:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:02:39 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:02:39 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:02:40 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:02:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:02:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:02:42 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:02:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:02:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:02:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:02:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:02:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:02:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:02:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:02:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:02:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:02:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:03:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:03:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:03:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:03:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:03:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:03:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:34 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:34 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:03:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:34 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:35 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:03:35 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:03:35 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=25.026866912841797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 69fc86e9-940c-4908-bf93-1d5453012c5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 07:03:35 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 07:03:36 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:03:36 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:03:36 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:03:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:03:39 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:03:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:40 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:03:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:03:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:03:42 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:42 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'flavor' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:03:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:43 user nova-compute[74295]: INFO nova.compute.manager [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Attaching volume b2c7f876-af23-4925-9dd6-ecd729d2b6c2 to /dev/vdb
Oct 26 07:03:43 user nova-compute[74295]: DEBUG os_brick.utils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c10a497-9c0c-4248-9f72-216654a83c79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1454ef-9ad7-442f-a6ae-a9634ddb60de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[14476405-1fa6-4188-9a0e-c55c6f2eac82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[368cbc8a-0a99-4eec-a3b3-12237d604098]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 07:03:43 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 07:03:43 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[70686236-8a6d-49cc-a5c7-126695263f77]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG os_brick.utils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating existing volume attachment record: 12dbccbd-fa42-4fda-a127-de1f697e8e4c {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 07:03:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:49 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_power_states {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:03:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Triggering sync for uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 07:03:49 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 07:03:50 user nova-compute[74295]: INFO nova.compute.claims [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Claim successful on node user
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.network.neutron [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 07:03:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 07:03:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Creating image(s)
Oct 26 07:03:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "/opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "/opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.166s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG nova.policy [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd84c0ab900e943f69d81d9363f1459e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea4a83d7704370bb3da9e360d917a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk 1073741824" returned: 0 in 0.046s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Cannot resize image /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Ensure instance console log exists: /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:51 user nova-compute[74295]: DEBUG nova.network.neutron [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Successfully created port: b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Successfully updated port: b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "refresh_cache-ac49c8cc-22af-4a21-ab7b-b56f56846ff9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquired lock "refresh_cache-ac49c8cc-22af-4a21-ab7b-b56f56846ff9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-be5cef0a-1e57-498c-8a9e-caa03edeceab req-c85239e5-6be2-49cb-9e39-a45bfea7d691 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received event network-changed-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.compute.manager [req-be5cef0a-1e57-498c-8a9e-caa03edeceab req-c85239e5-6be2-49cb-9e39-a45bfea7d691 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Refreshing instance network info cache due to event network-changed-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-be5cef0a-1e57-498c-8a9e-caa03edeceab req-c85239e5-6be2-49cb-9e39-a45bfea7d691 service nova] Acquiring lock "refresh_cache-ac49c8cc-22af-4a21-ab7b-b56f56846ff9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.network.neutron [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Updating instance_info_cache with network_info: [{"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Releasing lock "refresh_cache-ac49c8cc-22af-4a21-ab7b-b56f56846ff9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Instance network_info: |[{"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-be5cef0a-1e57-498c-8a9e-caa03edeceab req-c85239e5-6be2-49cb-9e39-a45bfea7d691 service nova] Acquired lock "refresh_cache-ac49c8cc-22af-4a21-ab7b-b56f56846ff9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.network.neutron [req-be5cef0a-1e57-498c-8a9e-caa03edeceab req-c85239e5-6be2-49cb-9e39-a45bfea7d691 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Refreshing network info cache for port b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Start _get_guest_xml network_info=[{"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 07:03:52 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:03:52 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1302536082',display_name='tempest-VolumesActionsTest-instance-1302536082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1302536082',id=50,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1ea4a83d7704370bb3da9e360d917a5',ramdisk_id='',reservation_id='r-m4xifp2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-94660942',owner_user_name='tempest-VolumesActionsTest-94660942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T07:03:51Z,user_data=None,user_id='d84c0ab900e943f69d81d9363f1459e4',uuid=ac49c8cc-22af-4a21-ab7b-b56f56846ff9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converting VIF {"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:15:0d,bridge_name='br-int',has_traffic_filtering=True,id=b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ad6785-b2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.objects.instance [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lazy-loading 'pci_devices' on Instance uuid ac49c8cc-22af-4a21-ab7b-b56f56846ff9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 07:03:52 user nova-compute[74295]:   <uuid>ac49c8cc-22af-4a21-ab7b-b56f56846ff9</uuid>
Oct 26 07:03:52 user nova-compute[74295]:   <name>instance-00000032</name>
Oct 26 07:03:52 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 07:03:52 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 07:03:52 user nova-compute[74295]:   <metadata>
Oct 26 07:03:52 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 07:03:52 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 07:03:52 user nova-compute[74295]:       <nova:name>tempest-VolumesActionsTest-instance-1302536082</nova:name>
Oct 26 07:03:52 user nova-compute[74295]:       <nova:creationTime>2023-10-26 07:03:52</nova:creationTime>
Oct 26 07:03:52 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 07:03:52 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 07:03:52 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 07:03:52 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 07:03:52 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 07:03:52 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 07:03:52 user nova-compute[74295]:       </nova:flavor>
Oct 26 07:03:52 user nova-compute[74295]:       <nova:owner>
Oct 26 07:03:52 user nova-compute[74295]:         <nova:user uuid="d84c0ab900e943f69d81d9363f1459e4">tempest-VolumesActionsTest-94660942-project-member</nova:user>
Oct 26 07:03:52 user nova-compute[74295]:         <nova:project uuid="c1ea4a83d7704370bb3da9e360d917a5">tempest-VolumesActionsTest-94660942</nova:project>
Oct 26 07:03:52 user nova-compute[74295]:       </nova:owner>
Oct 26 07:03:52 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 07:03:52 user nova-compute[74295]:       <nova:ports>
Oct 26 07:03:52 user nova-compute[74295]:         <nova:port uuid="b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1">
Oct 26 07:03:52 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 07:03:52 user nova-compute[74295]:         </nova:port>
Oct 26 07:03:52 user nova-compute[74295]:       </nova:ports>
Oct 26 07:03:52 user nova-compute[74295]:     </nova:instance>
Oct 26 07:03:52 user nova-compute[74295]:   </metadata>
Oct 26 07:03:52 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 07:03:52 user nova-compute[74295]:     <system>
Oct 26 07:03:52 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 07:03:52 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 07:03:52 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 07:03:52 user nova-compute[74295]:       <entry name="serial">ac49c8cc-22af-4a21-ab7b-b56f56846ff9</entry>
Oct 26 07:03:52 user nova-compute[74295]:       <entry name="uuid">ac49c8cc-22af-4a21-ab7b-b56f56846ff9</entry>
Oct 26 07:03:52 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 07:03:52 user nova-compute[74295]:     </system>
Oct 26 07:03:52 user nova-compute[74295]:   </sysinfo>
Oct 26 07:03:52 user nova-compute[74295]:   <os>
Oct 26 07:03:52 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 07:03:52 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 07:03:52 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 07:03:52 user nova-compute[74295]:   </os>
Oct 26 07:03:52 user nova-compute[74295]:   <features>
Oct 26 07:03:52 user nova-compute[74295]:     <acpi/>
Oct 26 07:03:52 user nova-compute[74295]:     <apic/>
Oct 26 07:03:52 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 07:03:52 user nova-compute[74295]:   </features>
Oct 26 07:03:52 user nova-compute[74295]:   <clock offset="utc">
Oct 26 07:03:52 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 07:03:52 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 07:03:52 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 07:03:52 user nova-compute[74295]:   </clock>
Oct 26 07:03:52 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 07:03:52 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 07:03:52 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 07:03:52 user nova-compute[74295]:   </cpu>
Oct 26 07:03:52 user nova-compute[74295]:   <devices>
Oct 26 07:03:52 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 07:03:52 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 07:03:52 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk"/>
Oct 26 07:03:52 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 07:03:52 user nova-compute[74295]:     </disk>
Oct 26 07:03:52 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 07:03:52 user nova-compute[74295]:       <mac address="fa:16:3e:69:15:0d"/>
Oct 26 07:03:52 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:03:52 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 07:03:52 user nova-compute[74295]:       <target dev="tapb1ad6785-b2"/>
Oct 26 07:03:52 user nova-compute[74295]:     </interface>
Oct 26 07:03:52 user nova-compute[74295]:     <serial type="pty">
Oct 26 07:03:52 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/console.log" append="off"/>
Oct 26 07:03:52 user nova-compute[74295]:     </serial>
Oct 26 07:03:52 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 07:03:52 user nova-compute[74295]:     <video>
Oct 26 07:03:52 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:03:52 user nova-compute[74295]:     </video>
Oct 26 07:03:52 user nova-compute[74295]:     <rng model="virtio">
Oct 26 07:03:52 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 07:03:52 user nova-compute[74295]:     </rng>
Oct 26 07:03:52 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 07:03:52 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 07:03:52 user nova-compute[74295]:       <stats period="10"/>
Oct 26 07:03:52 user nova-compute[74295]:     </memballoon>
Oct 26 07:03:52 user nova-compute[74295]:   </devices>
Oct 26 07:03:52 user nova-compute[74295]: </domain>
Oct 26 07:03:52 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1302536082',display_name='tempest-VolumesActionsTest-instance-1302536082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1302536082',id=50,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1ea4a83d7704370bb3da9e360d917a5',ramdisk_id='',reservation_id='r-m4xifp2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-94660942',owner_user_name='tempest-VolumesActionsTest-94660942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T07:03:51Z,user_data=None,user_id='d84c0ab900e943f69d81d9363f1459e4',uuid=ac49c8cc-22af-4a21-ab7b-b56f56846ff9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converting VIF {"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:15:0d,bridge_name='br-int',has_traffic_filtering=True,id=b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ad6785-b2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG os_vif [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:15:0d,bridge_name='br-int',has_traffic_filtering=True,id=b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ad6785-b2') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b95346b-54b3-5069-87ce-3c3e23c78339', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1ad6785-b2, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1ad6785-b2, col_values=(('qos', UUID('7fb9741f-5343-4c1a-8ca5-2b9422ecabb5')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1ad6785-b2, col_values=(('external_ids', {'iface-id': 'b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:15:0d', 'vm-uuid': 'ac49c8cc-22af-4a21-ab7b-b56f56846ff9'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:52 user nova-compute[74295]: INFO os_vif [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:15:0d,bridge_name='br-int',has_traffic_filtering=True,id=b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ad6785-b2')
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 07:03:52 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] No VIF found with MAC fa:16:3e:69:15:0d, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 07:03:53 user nova-compute[74295]: DEBUG nova.network.neutron [req-be5cef0a-1e57-498c-8a9e-caa03edeceab req-c85239e5-6be2-49cb-9e39-a45bfea7d691 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Updated VIF entry in instance network info cache for port b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:03:53 user nova-compute[74295]: DEBUG nova.network.neutron [req-be5cef0a-1e57-498c-8a9e-caa03edeceab req-c85239e5-6be2-49cb-9e39-a45bfea7d691 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Updating instance_info_cache with network_info: [{"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:03:53 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-be5cef0a-1e57-498c-8a9e-caa03edeceab req-c85239e5-6be2-49cb-9e39-a45bfea7d691 service nova] Releasing lock "refresh_cache-ac49c8cc-22af-4a21-ab7b-b56f56846ff9" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-5d056804-a760-46e2-a4ec-5c1d56b48647 req-bfd0f30d-70ae-4550-90b8-f6d076385a86 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received event network-vif-plugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5d056804-a760-46e2-a4ec-5c1d56b48647 req-bfd0f30d-70ae-4550-90b8-f6d076385a86 service nova] Acquiring lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5d056804-a760-46e2-a4ec-5c1d56b48647 req-bfd0f30d-70ae-4550-90b8-f6d076385a86 service nova] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-5d056804-a760-46e2-a4ec-5c1d56b48647 req-bfd0f30d-70ae-4550-90b8-f6d076385a86 service nova] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG nova.compute.manager [req-5d056804-a760-46e2-a4ec-5c1d56b48647 req-bfd0f30d-70ae-4550-90b8-f6d076385a86 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] No waiting events found dispatching network-vif-plugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:03:54 user nova-compute[74295]: WARNING nova.compute.manager [req-5d056804-a760-46e2-a4ec-5c1d56b48647 req-bfd0f30d-70ae-4550-90b8-f6d076385a86 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received unexpected event network-vif-plugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 for instance with vm_state building and task_state spawning.
Oct 26 07:03:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 07:03:56 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Instance spawned successfully.
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:03:56 user nova-compute[74295]: INFO nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-8259df91-c0ba-430f-8fe5-12fa07d8a2a9 req-69643804-f6d6-441e-9c48-0b04fe9a0f57 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received event network-vif-plugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8259df91-c0ba-430f-8fe5-12fa07d8a2a9 req-69643804-f6d6-441e-9c48-0b04fe9a0f57 service nova] Acquiring lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8259df91-c0ba-430f-8fe5-12fa07d8a2a9 req-69643804-f6d6-441e-9c48-0b04fe9a0f57 service nova] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8259df91-c0ba-430f-8fe5-12fa07d8a2a9 req-69643804-f6d6-441e-9c48-0b04fe9a0f57 service nova] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:56 user nova-compute[74295]: DEBUG nova.compute.manager [req-8259df91-c0ba-430f-8fe5-12fa07d8a2a9 req-69643804-f6d6-441e-9c48-0b04fe9a0f57 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] No waiting events found dispatching network-vif-plugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:03:56 user nova-compute[74295]: WARNING nova.compute.manager [req-8259df91-c0ba-430f-8fe5-12fa07d8a2a9 req-69643804-f6d6-441e-9c48-0b04fe9a0f57 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received unexpected event network-vif-plugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 for instance with vm_state building and task_state spawning.
Oct 26 07:03:56 user nova-compute[74295]: INFO nova.compute.manager [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Took 6.22 seconds to build instance.
Oct 26 07:03:56 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-adfd97f6-b014-459b-95eb-f6eed01b2dfa tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.352s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:03:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:03:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECqOuvNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 07:04:00 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 07:04:00 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 07:04:00 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[418fd679-aac6-4874-ae60-6ec83e662243]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 07:04:00 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c577550-8efb-4e62-8822-dd962d053df2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2] added
Oct 26 07:04:00 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[683d2287-d6bb-44cc-ba5b-9b60555ffc2f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[33283fc2-9efd-441a-9014-184b0549f4d5]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECqOuvNo {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECqOuvNo" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a084d4-7d1d-4a01-9fb5-160a6556ce7e]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECqOuvNo'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3065e09a-a47b-4419-87df-b393dc35bb99]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[189e2758-3afd-4065-80e8-7e97a76ed5bb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 07:04:00 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 07:04:00 user nova-compute[74295]:  {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 07:04:00 user nova-compute[74295]: WARNING os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 07:04:00 user nova-compute[74295]: 
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586ad04-05dc-40be-a041-0fa12f2b5478]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260]
Oct 26 07:04:00 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260] successful.
Oct 26 07:04:00 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767d99b-d634-4124-822e-506ca4b4d200]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa4dece-1866-4a56-8d7c-0fb9821327cf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)
Oct 26 07:04:00 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)
Oct 26 07:04:00 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d09c97-fa7a-473d-af8a-f2d640a31450]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:00 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 07:04:01 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 07:04:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECqOuvNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 07:04:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 07:04:01 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23533663233373036', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 07:04:01 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533663233373036', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 07:04:01 user nova-compute[74295]: DEBUG nova.objects.instance [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'flavor' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:04:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 07:04:02 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 07:04:02 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 07:04:02 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 07:04:02 user nova-compute[74295]:   <serial>b2c7f876-af23-4925-9dd6-ecd729d2b6c2</serial>
Oct 26 07:04:02 user nova-compute[74295]: </disk>
Oct 26 07:04:02 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 07:04:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 07:04:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 07:04:02 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No VIF found with MAC fa:16:3e:22:8c:bc, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 07:04:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-f824c5b6-561b-4411-ad1b-1b9700ac8a7d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.396s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:04:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.524s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:04:02 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:04:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:04:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:04:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:04:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:04:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:04:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-373054cf-1614-451a-9f6f-72077cc6f3e5 req-bb6ab0e4-e220-436d-a027-65d64a65adef service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:04:15 user nova-compute[74295]: DEBUG nova.compute.manager [req-373054cf-1614-451a-9f6f-72077cc6f3e5 req-bb6ab0e4-e220-436d-a027-65d64a65adef service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing instance network info cache due to event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:04:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-373054cf-1614-451a-9f6f-72077cc6f3e5 req-bb6ab0e4-e220-436d-a027-65d64a65adef service nova] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:04:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-373054cf-1614-451a-9f6f-72077cc6f3e5 req-bb6ab0e4-e220-436d-a027-65d64a65adef service nova] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:04:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-373054cf-1614-451a-9f6f-72077cc6f3e5 req-bb6ab0e4-e220-436d-a027-65d64a65adef service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:04:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-373054cf-1614-451a-9f6f-72077cc6f3e5 req-bb6ab0e4-e220-436d-a027-65d64a65adef service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updated VIF entry in instance network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:04:15 user nova-compute[74295]: DEBUG nova.network.neutron [req-373054cf-1614-451a-9f6f-72077cc6f3e5 req-bb6ab0e4-e220-436d-a027-65d64a65adef service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:04:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-373054cf-1614-451a-9f6f-72077cc6f3e5 req-bb6ab0e4-e220-436d-a027-65d64a65adef service nova] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:04:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-f858b1d3-6f7a-4786-aeab-6f81b2e47d1d req-f9f2f7e4-8652-47f1-901f-292972dc7142 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:04:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-f858b1d3-6f7a-4786-aeab-6f81b2e47d1d req-f9f2f7e4-8652-47f1-901f-292972dc7142 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing instance network info cache due to event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:04:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f858b1d3-6f7a-4786-aeab-6f81b2e47d1d req-f9f2f7e4-8652-47f1-901f-292972dc7142 service nova] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:04:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f858b1d3-6f7a-4786-aeab-6f81b2e47d1d req-f9f2f7e4-8652-47f1-901f-292972dc7142 service nova] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:04:17 user nova-compute[74295]: DEBUG nova.network.neutron [req-f858b1d3-6f7a-4786-aeab-6f81b2e47d1d req-f9f2f7e4-8652-47f1-901f-292972dc7142 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:04:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:18 user nova-compute[74295]: DEBUG nova.network.neutron [req-f858b1d3-6f7a-4786-aeab-6f81b2e47d1d req-f9f2f7e4-8652-47f1-901f-292972dc7142 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updated VIF entry in instance network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:04:18 user nova-compute[74295]: DEBUG nova.network.neutron [req-f858b1d3-6f7a-4786-aeab-6f81b2e47d1d req-f9f2f7e4-8652-47f1-901f-292972dc7142 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:04:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:18 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-f858b1d3-6f7a-4786-aeab-6f81b2e47d1d req-f9f2f7e4-8652-47f1-901f-292972dc7142 service nova] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:04:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:04:27 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:04:27 user nova-compute[74295]: INFO nova.compute.manager [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Rebooting instance
Oct 26 07:04:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG nova.network.neutron [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-7a128c42-c27e-45a7-97ec-62b72ed595a7 req-34905699-533a-47de-8f1b-a80c73bb611c service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-unplugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7a128c42-c27e-45a7-97ec-62b72ed595a7 req-34905699-533a-47de-8f1b-a80c73bb611c service nova] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7a128c42-c27e-45a7-97ec-62b72ed595a7 req-34905699-533a-47de-8f1b-a80c73bb611c service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-7a128c42-c27e-45a7-97ec-62b72ed595a7 req-34905699-533a-47de-8f1b-a80c73bb611c service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:04:28 user nova-compute[74295]: DEBUG nova.compute.manager [req-7a128c42-c27e-45a7-97ec-62b72ed595a7 req-34905699-533a-47de-8f1b-a80c73bb611c service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] No waiting events found dispatching network-vif-unplugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:04:28 user nova-compute[74295]: WARNING nova.compute.manager [req-7a128c42-c27e-45a7-97ec-62b72ed595a7 req-34905699-533a-47de-8f1b-a80c73bb611c service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received unexpected event network-vif-unplugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:29 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Instance destroyed successfully.
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'resources' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1914782709',display_name='tempest-TestMinimumBasicScenario-server-1914782709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1914782709',id=49,image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaRv8ANlSgUHRv/nDFHs+nItRh5zcQgCRgEh547YsGttZ22djFF9IjemxGCQTDPSDlFbSXA7hynslyggfdgBwK8c/9GXMIVS47JSmUnhO95iu+++L6Z8ZML/rg7rzYPkA==',key_name='tempest-TestMinimumBasicScenario-1113082317',keypairs=<?>,launch_index=0,launched_at=2023-10-26T07:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8ca02ae7f949259a2709a5ffa98852',ramdisk_id='',reservation_id='r-q1ufesh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-230365205',owner_user_name='tempest-TestMinimumBasicScenario-230365205-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T07:04:29Z,user_data=None,user_id='f57b2d2a359e42f6916e19d83c33ad99',uuid=69fc86e9-940c-4908-bf93-1d5453012c5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converting VIF {"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_vif [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93f8fb4b-a0, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccb19e4d-89c5-4d9b-85fd-eea925b7d8ba) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:04:29 user nova-compute[74295]: INFO os_vif [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0')
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECqOuvNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 07:04:29 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a34ae8-b28a-4f1d-9681-22045b56dea2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 07:04:29 user nova-compute[74295]: No targets found.
Oct 26 07:04:29 user nova-compute[74295]: iSNS:
Oct 26 07:04:29 user nova-compute[74295]: No targets found.
Oct 26 07:04:29 user nova-compute[74295]: STATIC:
Oct 26 07:04:29 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2
Oct 26 07:04:29 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 07:04:29 user nova-compute[74295]:                 Iface Name: default
Oct 26 07:04:29 user nova-compute[74295]: FIRMWARE:
Oct 26 07:04:29 user nova-compute[74295]: No targets found.
Oct 26 07:04:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 07:04:29 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 07:04:29 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cca85b-ea45-4a9d-90da-bc8b17fa6795]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d113397-ebb6-43cf-b3b2-0bcc37ebd29c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)
Oct 26 07:04:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)
Oct 26 07:04:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3588794a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[98029852-5aca-441f-8010-e5a124cd8d24]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[720de92b-9444-40d7-a3e5-78bb74cc31db]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72446c5-f537-4857-bba7-26f3e1d2ff39]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c3f370-8166-4e36-b313-6e9f7157656b]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba945de7-9a35-4ba4-9877-d760f116ce8d]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b307c181-e0e9-4f46-99e8-9ef07934b72c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260]
Oct 26 07:04:29 user nova-compute[74295]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260] successful.
Oct 26 07:04:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e35be5-da9a-4bc5-8df6-c2ab5f65d6a1]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] <== disconnect_volume: return (291ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Start _get_guest_xml network_info=[{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e930dac7-088b-424c-9354-ebc0f2dcfc7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'e930dac7-088b-424c-9354-ebc0f2dcfc7c'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '12dbccbd-fa42-4fda-a127-de1f697e8e4c', 'boot_index': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECqOuvNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '69fc86e9-940c-4908-bf93-1d5453012c5c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 'serial': 'b2c7f876-af23-4925-9dd6-ecd729d2b6c2'}, 'volume_type': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 07:04:29 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:04:29 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e930dac7-088b-424c-9354-ebc0f2dcfc7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.objects.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Object Instance<69fc86e9-940c-4908-bf93-1d5453012c5c> lazy-loaded attributes: resources,vcpu_model {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECqOuvNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 07:04:29 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 07:04:29 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 07:04:29 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab82c5fb-13e5-46f5-bdb0-c281eb646706]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 07:04:29 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06d1ea3-69e1-4f5b-8ec6-e7f423caa353]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2] added
Oct 26 07:04:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[856bd444-9ef0-46c6-b635-d27dfb820ea0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bca854-5a5a-49ce-8fdb-e80c7a9d8291]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECqOuvNo {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECqOuvNo" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778e309-d3f2-4f84-8078-abe891ae4419]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECqOuvNo'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4a7504-ce12-426d-b958-9736485c6aaa]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c8e86-332f-48cb-ac99-c868f055c07e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 07:04:29 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 07:04:29 user nova-compute[74295]:  {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 07:04:29 user nova-compute[74295]: WARNING os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 07:04:29 user nova-compute[74295]: 
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b2329c-e382-46c0-90a4-ac40358ea1d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260]
Oct 26 07:04:29 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260] successful.
Oct 26 07:04:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88ff51f-1837-455b-9a20-d6c48d94c4f6]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f941e357-7a46-4007-b1a8-1e3aa395bb62]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)
Oct 26 07:04:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)
Oct 26 07:04:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 07:04:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade67db-7b5f-4a5d-98e8-a3aca894787e]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-12d7f126-76e0-4dfa-8ee0-75fdb8aa2b7f req-b1fe985d-1bdd-4314-9623-3d344f2a9390 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12d7f126-76e0-4dfa-8ee0-75fdb8aa2b7f req-b1fe985d-1bdd-4314-9623-3d344f2a9390 service nova] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12d7f126-76e0-4dfa-8ee0-75fdb8aa2b7f req-b1fe985d-1bdd-4314-9623-3d344f2a9390 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-12d7f126-76e0-4dfa-8ee0-75fdb8aa2b7f req-b1fe985d-1bdd-4314-9623-3d344f2a9390 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:04:30 user nova-compute[74295]: DEBUG nova.compute.manager [req-12d7f126-76e0-4dfa-8ee0-75fdb8aa2b7f req-b1fe985d-1bdd-4314-9623-3d344f2a9390 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] No waiting events found dispatching network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:04:30 user nova-compute[74295]: WARNING nova.compute.manager [req-12d7f126-76e0-4dfa-8ee0-75fdb8aa2b7f req-b1fe985d-1bdd-4314-9623-3d344f2a9390 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received unexpected event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 07:04:31 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECqOuvNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23533663233373036', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533663233373036', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1914782709',display_name='tempest-TestMinimumBasicScenario-server-1914782709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1914782709',id=49,image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaRv8ANlSgUHRv/nDFHs+nItRh5zcQgCRgEh547YsGttZ22djFF9IjemxGCQTDPSDlFbSXA7hynslyggfdgBwK8c/9GXMIVS47JSmUnhO95iu+++L6Z8ZML/rg7rzYPkA==',key_name='tempest-TestMinimumBasicScenario-1113082317',keypairs=<?>,launch_index=0,launched_at=2023-10-26T07:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8ca02ae7f949259a2709a5ffa98852',ramdisk_id='',reservation_id='r-q1ufesh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-230365205',owner_user_name='tempest-TestMinimumBasicScenario-230365205-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T07:04:29Z,user_data=None,user_id='f57b2d2a359e42f6916e19d83c33ad99',uuid=69fc86e9-940c-4908-bf93-1d5453012c5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converting VIF {"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'pci_devices' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.objects.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Object Instance<69fc86e9-940c-4908-bf93-1d5453012c5c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 07:04:31 user nova-compute[74295]:   <uuid>69fc86e9-940c-4908-bf93-1d5453012c5c</uuid>
Oct 26 07:04:31 user nova-compute[74295]:   <name>instance-00000031</name>
Oct 26 07:04:31 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 07:04:31 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 07:04:31 user nova-compute[74295]:   <metadata>
Oct 26 07:04:31 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 07:04:31 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 07:04:31 user nova-compute[74295]:       <nova:name>tempest-TestMinimumBasicScenario-server-1914782709</nova:name>
Oct 26 07:04:31 user nova-compute[74295]:       <nova:creationTime>2023-10-26 07:04:29</nova:creationTime>
Oct 26 07:04:31 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 07:04:31 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 07:04:31 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 07:04:31 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 07:04:31 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 07:04:31 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 07:04:31 user nova-compute[74295]:       </nova:flavor>
Oct 26 07:04:31 user nova-compute[74295]:       <nova:owner>
Oct 26 07:04:31 user nova-compute[74295]:         <nova:user uuid="f57b2d2a359e42f6916e19d83c33ad99">tempest-TestMinimumBasicScenario-230365205-project-member</nova:user>
Oct 26 07:04:31 user nova-compute[74295]:         <nova:project uuid="7c8ca02ae7f949259a2709a5ffa98852">tempest-TestMinimumBasicScenario-230365205</nova:project>
Oct 26 07:04:31 user nova-compute[74295]:       </nova:owner>
Oct 26 07:04:31 user nova-compute[74295]:       <nova:root type="image" uuid="e930dac7-088b-424c-9354-ebc0f2dcfc7c"/>
Oct 26 07:04:31 user nova-compute[74295]:       <nova:ports>
Oct 26 07:04:31 user nova-compute[74295]:         <nova:port uuid="93f8fb4b-a09f-4444-8389-3f3efa7dec33">
Oct 26 07:04:31 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 07:04:31 user nova-compute[74295]:         </nova:port>
Oct 26 07:04:31 user nova-compute[74295]:       </nova:ports>
Oct 26 07:04:31 user nova-compute[74295]:     </nova:instance>
Oct 26 07:04:31 user nova-compute[74295]:   </metadata>
Oct 26 07:04:31 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 07:04:31 user nova-compute[74295]:     <system>
Oct 26 07:04:31 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 07:04:31 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 07:04:31 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 07:04:31 user nova-compute[74295]:       <entry name="serial">69fc86e9-940c-4908-bf93-1d5453012c5c</entry>
Oct 26 07:04:31 user nova-compute[74295]:       <entry name="uuid">69fc86e9-940c-4908-bf93-1d5453012c5c</entry>
Oct 26 07:04:31 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 07:04:31 user nova-compute[74295]:     </system>
Oct 26 07:04:31 user nova-compute[74295]:   </sysinfo>
Oct 26 07:04:31 user nova-compute[74295]:   <os>
Oct 26 07:04:31 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 07:04:31 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 07:04:31 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 07:04:31 user nova-compute[74295]:   </os>
Oct 26 07:04:31 user nova-compute[74295]:   <features>
Oct 26 07:04:31 user nova-compute[74295]:     <acpi/>
Oct 26 07:04:31 user nova-compute[74295]:     <apic/>
Oct 26 07:04:31 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 07:04:31 user nova-compute[74295]:   </features>
Oct 26 07:04:31 user nova-compute[74295]:   <clock offset="utc">
Oct 26 07:04:31 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 07:04:31 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 07:04:31 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 07:04:31 user nova-compute[74295]:   </clock>
Oct 26 07:04:31 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 07:04:31 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 07:04:31 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 07:04:31 user nova-compute[74295]:   </cpu>
Oct 26 07:04:31 user nova-compute[74295]:   <devices>
Oct 26 07:04:31 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 07:04:31 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 07:04:31 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk"/>
Oct 26 07:04:31 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 07:04:31 user nova-compute[74295]:     </disk>
Oct 26 07:04:31 user nova-compute[74295]:     <disk type="block" device="disk">
Oct 26 07:04:31 user nova-compute[74295]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 07:04:31 user nova-compute[74295]:       <source dev="/dev/sdb"/>
Oct 26 07:04:31 user nova-compute[74295]:       <target dev="vdb" bus="virtio"/>
Oct 26 07:04:31 user nova-compute[74295]:       <serial>b2c7f876-af23-4925-9dd6-ecd729d2b6c2</serial>
Oct 26 07:04:31 user nova-compute[74295]:     </disk>
Oct 26 07:04:31 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 07:04:31 user nova-compute[74295]:       <mac address="fa:16:3e:22:8c:bc"/>
Oct 26 07:04:31 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:04:31 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 07:04:31 user nova-compute[74295]:       <target dev="tap93f8fb4b-a0"/>
Oct 26 07:04:31 user nova-compute[74295]:     </interface>
Oct 26 07:04:31 user nova-compute[74295]:     <serial type="pty">
Oct 26 07:04:31 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/console.log" append="off"/>
Oct 26 07:04:31 user nova-compute[74295]:     </serial>
Oct 26 07:04:31 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 07:04:31 user nova-compute[74295]:     <video>
Oct 26 07:04:31 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:04:31 user nova-compute[74295]:     </video>
Oct 26 07:04:31 user nova-compute[74295]:     <rng model="virtio">
Oct 26 07:04:31 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 07:04:31 user nova-compute[74295]:     </rng>
Oct 26 07:04:31 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 07:04:31 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 07:04:31 user nova-compute[74295]:       <stats period="10"/>
Oct 26 07:04:31 user nova-compute[74295]:     </memballoon>
Oct 26 07:04:31 user nova-compute[74295]:   </devices>
Oct 26 07:04:31 user nova-compute[74295]: </domain>
Oct 26 07:04:31 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.objects.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Object Instance<69fc86e9-940c-4908-bf93-1d5453012c5c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/62d42c02e95b128ce1c5a420682a5e69f871c211 --force-share --output=json" returned: 0 in 0.177s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Cannot resize image /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.objects.instance [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'migration_context' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.objects.base [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Object Instance<69fc86e9-940c-4908-bf93-1d5453012c5c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74295) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1914782709',display_name='tempest-TestMinimumBasicScenario-server-1914782709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1914782709',id=49,image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaRv8ANlSgUHRv/nDFHs+nItRh5zcQgCRgEh547YsGttZ22djFF9IjemxGCQTDPSDlFbSXA7hynslyggfdgBwK8c/9GXMIVS47JSmUnhO95iu+++L6Z8ZML/rg7rzYPkA==',key_name='tempest-TestMinimumBasicScenario-1113082317',keypairs=<?>,launch_index=0,launched_at=2023-10-26T07:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7c8ca02ae7f949259a2709a5ffa98852',ramdisk_id='',reservation_id='r-q1ufesh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-230365205',owner_user_name='tempest-TestMinimumBasicScenario-230365205-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T07:04:29Z,user_data=None,user_id='f57b2d2a359e42f6916e19d83c33ad99',uuid=69fc86e9-940c-4908-bf93-1d5453012c5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converting VIF {"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG os_vif [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfe3dc41-1d9d-5a7f-870d-d6edab63286a', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93f8fb4b-a0, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93f8fb4b-a0, col_values=(('qos', UUID('e8b06c1f-8385-4b05-b3e5-d8097cbc763a')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93f8fb4b-a0, col_values=(('external_ids', {'iface-id': '93f8fb4b-a09f-4444-8389-3f3efa7dec33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:8c:bc', 'vm-uuid': '69fc86e9-940c-4908-bf93-1d5453012c5c'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:04:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:31 user nova-compute[74295]: INFO os_vif [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0')
Oct 26 07:04:32 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-eabfb5e7-82cd-4584-896b-df8932e43db4 req-71463b5e-863d-4d6f-af59-9afc84b32aee service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-eabfb5e7-82cd-4584-896b-df8932e43db4 req-71463b5e-863d-4d6f-af59-9afc84b32aee service nova] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-eabfb5e7-82cd-4584-896b-df8932e43db4 req-71463b5e-863d-4d6f-af59-9afc84b32aee service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-eabfb5e7-82cd-4584-896b-df8932e43db4 req-71463b5e-863d-4d6f-af59-9afc84b32aee service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG nova.compute.manager [req-eabfb5e7-82cd-4584-896b-df8932e43db4 req-71463b5e-863d-4d6f-af59-9afc84b32aee service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] No waiting events found dispatching network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:04:33 user nova-compute[74295]: WARNING nova.compute.manager [req-eabfb5e7-82cd-4584-896b-df8932e43db4 req-71463b5e-863d-4d6f-af59-9afc84b32aee service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received unexpected event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 07:04:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:35 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 07:04:35 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Instance rebooted successfully.
Oct 26 07:04:35 user nova-compute[74295]: DEBUG nova.compute.manager [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 07:04:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-3b6c00e1-9690-4380-afc1-77c859c90962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.459s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:04:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-77c91561-a821-46d5-810e-1a65035eea44 req-f7faa246-fda5-42ca-82e2-83b2303ac75b service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:04:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-77c91561-a821-46d5-810e-1a65035eea44 req-f7faa246-fda5-42ca-82e2-83b2303ac75b service nova] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:04:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-77c91561-a821-46d5-810e-1a65035eea44 req-f7faa246-fda5-42ca-82e2-83b2303ac75b service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:04:35 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-77c91561-a821-46d5-810e-1a65035eea44 req-f7faa246-fda5-42ca-82e2-83b2303ac75b service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:04:35 user nova-compute[74295]: DEBUG nova.compute.manager [req-77c91561-a821-46d5-810e-1a65035eea44 req-f7faa246-fda5-42ca-82e2-83b2303ac75b service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] No waiting events found dispatching network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:04:35 user nova-compute[74295]: WARNING nova.compute.manager [req-77c91561-a821-46d5-810e-1a65035eea44 req-f7faa246-fda5-42ca-82e2-83b2303ac75b service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received unexpected event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 for instance with vm_state active and task_state None.
Oct 26 07:04:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:04:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:04:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:04:36 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:04:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 07:04:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:04:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:04:37 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:04:37 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:04:37 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=24.995098114013672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:04:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:04:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:04:38 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 69fc86e9-940c-4908-bf93-1d5453012c5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:04:38 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance ac49c8cc-22af-4a21-ab7b-b56f56846ff9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:04:38 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:04:38 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:04:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:38 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:04:38 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:04:38 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:04:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:04:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:04:41 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:41 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:04:41 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:04:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:04:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:04:41 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:04:41 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:04:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:42 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:04:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:04:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:04:43 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:55 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:04:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:04:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:05:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:30 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:05:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:05:34 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:05:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:05:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:05:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:05:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:05:36 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:05:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:05:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:05:36 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:05:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:05:37 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:05:37 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:05:37 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=24.994239807128906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 69fc86e9-940c-4908-bf93-1d5453012c5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance ac49c8cc-22af-4a21-ab7b-b56f56846ff9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:05:37 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:05:38 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:05:38 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:05:38 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:05:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:05:40 user nova-compute[74295]: INFO nova.compute.manager [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Terminating instance
Oct 26 07:05:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-c712a2d5-617d-4019-ac1b-c128f1d9defa req-14c14ecd-69d6-43e2-bbfe-83d8d7552f02 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received event network-vif-unplugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c712a2d5-617d-4019-ac1b-c128f1d9defa req-14c14ecd-69d6-43e2-bbfe-83d8d7552f02 service nova] Acquiring lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c712a2d5-617d-4019-ac1b-c128f1d9defa req-14c14ecd-69d6-43e2-bbfe-83d8d7552f02 service nova] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c712a2d5-617d-4019-ac1b-c128f1d9defa req-14c14ecd-69d6-43e2-bbfe-83d8d7552f02 service nova] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-c712a2d5-617d-4019-ac1b-c128f1d9defa req-14c14ecd-69d6-43e2-bbfe-83d8d7552f02 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] No waiting events found dispatching network-vif-unplugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:05:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-c712a2d5-617d-4019-ac1b-c128f1d9defa req-14c14ecd-69d6-43e2-bbfe-83d8d7552f02 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received event network-vif-unplugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:41 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Instance destroyed successfully.
Oct 26 07:05:41 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lazy-loading 'resources' on Instance uuid ac49c8cc-22af-4a21-ab7b-b56f56846ff9 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1302536082',display_name='tempest-VolumesActionsTest-instance-1302536082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1302536082',id=50,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T07:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1ea4a83d7704370bb3da9e360d917a5',ramdisk_id='',reservation_id='r-m4xifp2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-94660942',owner_user_name='tempest-VolumesActionsTest-94660942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T07:03:57Z,user_data=None,user_id='d84c0ab900e943f69d81d9363f1459e4',uuid=ac49c8cc-22af-4a21-ab7b-b56f56846ff9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converting VIF {"id": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "address": "fa:16:3e:69:15:0d", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ad6785-b2", "ovs_interfaceid": "b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:15:0d,bridge_name='br-int',has_traffic_filtering=True,id=b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ad6785-b2') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG os_vif [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:15:0d,bridge_name='br-int',has_traffic_filtering=True,id=b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ad6785-b2') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1ad6785-b2, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fb9741f-5343-4c1a-8ca5-2b9422ecabb5) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:05:41 user nova-compute[74295]: INFO os_vif [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:15:0d,bridge_name='br-int',has_traffic_filtering=True,id=b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ad6785-b2')
Oct 26 07:05:41 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Deleting instance files /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9_del
Oct 26 07:05:41 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Deletion of /opt/stack/data/nova/instances/ac49c8cc-22af-4a21-ab7b-b56f56846ff9_del complete
Oct 26 07:05:41 user nova-compute[74295]: INFO nova.compute.manager [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 26 07:05:41 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:05:41 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:05:41 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Took 0.46 seconds to deallocate network for instance.
Oct 26 07:05:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-542bb723-49a7-4f2f-8736-0c58f1a2d44c req-26d88389-a1b1-4691-846c-d6c580b8961d service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received event network-vif-deleted-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:05:42 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Deleted allocations for instance ac49c8cc-22af-4a21-ab7b-b56f56846ff9
Oct 26 07:05:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b7f4809d-244e-48f5-a058-f001b9dd1ec1 tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.636s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-c61bbc40-9085-4b03-800d-3619d9b5f6a3 req-c7834006-90a4-45c4-ba66-e7f77e81bde4 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received event network-vif-plugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c61bbc40-9085-4b03-800d-3619d9b5f6a3 req-c7834006-90a4-45c4-ba66-e7f77e81bde4 service nova] Acquiring lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c61bbc40-9085-4b03-800d-3619d9b5f6a3 req-c7834006-90a4-45c4-ba66-e7f77e81bde4 service nova] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c61bbc40-9085-4b03-800d-3619d9b5f6a3 req-c7834006-90a4-45c4-ba66-e7f77e81bde4 service nova] Lock "ac49c8cc-22af-4a21-ab7b-b56f56846ff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:05:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-c61bbc40-9085-4b03-800d-3619d9b5f6a3 req-c7834006-90a4-45c4-ba66-e7f77e81bde4 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] No waiting events found dispatching network-vif-plugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:05:42 user nova-compute[74295]: WARNING nova.compute.manager [req-c61bbc40-9085-4b03-800d-3619d9b5f6a3 req-c7834006-90a4-45c4-ba66-e7f77e81bde4 service nova] [instance: ac49c8cc-22af-4a21-ab7b-b56f56846ff9] Received unexpected event network-vif-plugged-b1ad6785-b2ca-4194-9cf2-8ccf47c09ba1 for instance with vm_state deleted and task_state None.
Oct 26 07:05:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:05:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:05:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:05:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:05:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:05:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:05:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:05:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:05:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:06:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:06:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a88d3651-72e4-4d6e-b7fe-277c94f27e58 req-95ddfac8-8dad-4eed-adb4-19d4fa058d43 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:06:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-a88d3651-72e4-4d6e-b7fe-277c94f27e58 req-95ddfac8-8dad-4eed-adb4-19d4fa058d43 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing instance network info cache due to event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:06:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a88d3651-72e4-4d6e-b7fe-277c94f27e58 req-95ddfac8-8dad-4eed-adb4-19d4fa058d43 service nova] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:06:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a88d3651-72e4-4d6e-b7fe-277c94f27e58 req-95ddfac8-8dad-4eed-adb4-19d4fa058d43 service nova] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:06:19 user nova-compute[74295]: DEBUG nova.network.neutron [req-a88d3651-72e4-4d6e-b7fe-277c94f27e58 req-95ddfac8-8dad-4eed-adb4-19d4fa058d43 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:06:20 user nova-compute[74295]: DEBUG nova.network.neutron [req-a88d3651-72e4-4d6e-b7fe-277c94f27e58 req-95ddfac8-8dad-4eed-adb4-19d4fa058d43 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updated VIF entry in instance network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:06:20 user nova-compute[74295]: DEBUG nova.network.neutron [req-a88d3651-72e4-4d6e-b7fe-277c94f27e58 req-95ddfac8-8dad-4eed-adb4-19d4fa058d43 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:06:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a88d3651-72e4-4d6e-b7fe-277c94f27e58 req-95ddfac8-8dad-4eed-adb4-19d4fa058d43 service nova] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:06:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-83d37929-dccd-489c-b5dd-0be9a4bcc90b req-6512334c-b6fe-4a34-a73d-1aef05dcd52c service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:06:20 user nova-compute[74295]: DEBUG nova.compute.manager [req-83d37929-dccd-489c-b5dd-0be9a4bcc90b req-6512334c-b6fe-4a34-a73d-1aef05dcd52c service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing instance network info cache due to event network-changed-93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:06:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-83d37929-dccd-489c-b5dd-0be9a4bcc90b req-6512334c-b6fe-4a34-a73d-1aef05dcd52c service nova] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:06:20 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-83d37929-dccd-489c-b5dd-0be9a4bcc90b req-6512334c-b6fe-4a34-a73d-1aef05dcd52c service nova] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:06:20 user nova-compute[74295]: DEBUG nova.network.neutron [req-83d37929-dccd-489c-b5dd-0be9a4bcc90b req-6512334c-b6fe-4a34-a73d-1aef05dcd52c service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Refreshing network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:06:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:21 user nova-compute[74295]: INFO nova.compute.manager [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Detaching volume b2c7f876-af23-4925-9dd6-ecd729d2b6c2
Oct 26 07:06:21 user nova-compute[74295]: INFO nova.virt.block_device [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Attempting to driver detach volume b2c7f876-af23-4925-9dd6-ecd729d2b6c2 from mountpoint /dev/vdb
Oct 26 07:06:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Attempting to detach device vdb from instance 69fc86e9-940c-4908-bf93-1d5453012c5c from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 07:06:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 07:06:21 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 07:06:21 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 07:06:21 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 07:06:21 user nova-compute[74295]:   <serial>b2c7f876-af23-4925-9dd6-ecd729d2b6c2</serial>
Oct 26 07:06:21 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 07:06:21 user nova-compute[74295]: </disk>
Oct 26 07:06:21 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 07:06:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully detached device vdb from instance 69fc86e9-940c-4908-bf93-1d5453012c5c from the persistent domain config.
Oct 26 07:06:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69fc86e9-940c-4908-bf93-1d5453012c5c from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 07:06:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 07:06:21 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 07:06:21 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 07:06:21 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 07:06:21 user nova-compute[74295]:   <serial>b2c7f876-af23-4925-9dd6-ecd729d2b6c2</serial>
Oct 26 07:06:21 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 07:06:21 user nova-compute[74295]: </disk>
Oct 26 07:06:21 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 07:06:21 user nova-compute[74295]: DEBUG nova.network.neutron [req-83d37929-dccd-489c-b5dd-0be9a4bcc90b req-6512334c-b6fe-4a34-a73d-1aef05dcd52c service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updated VIF entry in instance network info cache for port 93f8fb4b-a09f-4444-8389-3f3efa7dec33. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:06:21 user nova-compute[74295]: DEBUG nova.network.neutron [req-83d37929-dccd-489c-b5dd-0be9a4bcc90b req-6512334c-b6fe-4a34-a73d-1aef05dcd52c service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:06:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-83d37929-dccd-489c-b5dd-0be9a4bcc90b req-6512334c-b6fe-4a34-a73d-1aef05dcd52c service nova] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:06:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:06:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 07:06:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:31 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "02f7cdb7-5370-4a42-99df-d288b10abb5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 07:06:32 user nova-compute[74295]: INFO nova.compute.claims [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Claim successful on node user
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 07:06:32 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.policy [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd84c0ab900e943f69d81d9363f1459e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ea4a83d7704370bb3da9e360d917a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 07:06:32 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Creating image(s)
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "/opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "/opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "/opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.170s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "b859282fd6e0636caa9ed032a12deb0ef0500799" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:32 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799,backing_fmt=raw /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk 1073741824" returned: 0 in 0.053s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "b859282fd6e0636caa9ed032a12deb0ef0500799" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Successfully created port: e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b859282fd6e0636caa9ed032a12deb0ef0500799 --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Cannot resize image /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Ensure instance console log exists: /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:33 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Successfully updated port: e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "refresh_cache-02f7cdb7-5370-4a42-99df-d288b10abb5e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquired lock "refresh_cache-02f7cdb7-5370-4a42-99df-d288b10abb5e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-d83d1a8b-9165-4e10-928a-9ff99e0212da req-6cdbb7a4-3981-4ca9-a188-3b4019b9e562 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received event network-changed-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-d83d1a8b-9165-4e10-928a-9ff99e0212da req-6cdbb7a4-3981-4ca9-a188-3b4019b9e562 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Refreshing instance network info cache due to event network-changed-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d83d1a8b-9165-4e10-928a-9ff99e0212da req-6cdbb7a4-3981-4ca9-a188-3b4019b9e562 service nova] Acquiring lock "refresh_cache-02f7cdb7-5370-4a42-99df-d288b10abb5e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.neutron [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Updating instance_info_cache with network_info: [{"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Releasing lock "refresh_cache-02f7cdb7-5370-4a42-99df-d288b10abb5e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Instance network_info: |[{"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d83d1a8b-9165-4e10-928a-9ff99e0212da req-6cdbb7a4-3981-4ca9-a188-3b4019b9e562 service nova] Acquired lock "refresh_cache-02f7cdb7-5370-4a42-99df-d288b10abb5e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-d83d1a8b-9165-4e10-928a-9ff99e0212da req-6cdbb7a4-3981-4ca9-a188-3b4019b9e562 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Refreshing network info cache for port e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Start _get_guest_xml network_info=[{"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 07:06:34 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:06:34 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T06:22:24Z,direct_url=<?>,disk_format='qcow2',id=f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3f29a24ad5e242c28bfe355ce6dec8ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T06:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-781733888',display_name='tempest-VolumesActionsTest-instance-781733888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-781733888',id=51,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1ea4a83d7704370bb3da9e360d917a5',ramdisk_id='',reservation_id='r-8pox164z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-94660942',owner_user_name='tempest-VolumesActionsTest-94660942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T07:06:33Z,user_data=None,user_id='d84c0ab900e943f69d81d9363f1459e4',uuid=02f7cdb7-5370-4a42-99df-d288b10abb5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converting VIF {"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:73,bridge_name='br-int',has_traffic_filtering=True,id=e9abfb83-34a9-4c1b-b4f9-5157c83ffaea,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9abfb83-34') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.objects.instance [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lazy-loading 'pci_devices' on Instance uuid 02f7cdb7-5370-4a42-99df-d288b10abb5e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 07:06:34 user nova-compute[74295]:   <uuid>02f7cdb7-5370-4a42-99df-d288b10abb5e</uuid>
Oct 26 07:06:34 user nova-compute[74295]:   <name>instance-00000033</name>
Oct 26 07:06:34 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 07:06:34 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 07:06:34 user nova-compute[74295]:   <metadata>
Oct 26 07:06:34 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 07:06:34 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 07:06:34 user nova-compute[74295]:       <nova:name>tempest-VolumesActionsTest-instance-781733888</nova:name>
Oct 26 07:06:34 user nova-compute[74295]:       <nova:creationTime>2023-10-26 07:06:34</nova:creationTime>
Oct 26 07:06:34 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 07:06:34 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 07:06:34 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 07:06:34 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 07:06:34 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 07:06:34 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 07:06:34 user nova-compute[74295]:       </nova:flavor>
Oct 26 07:06:34 user nova-compute[74295]:       <nova:owner>
Oct 26 07:06:34 user nova-compute[74295]:         <nova:user uuid="d84c0ab900e943f69d81d9363f1459e4">tempest-VolumesActionsTest-94660942-project-member</nova:user>
Oct 26 07:06:34 user nova-compute[74295]:         <nova:project uuid="c1ea4a83d7704370bb3da9e360d917a5">tempest-VolumesActionsTest-94660942</nova:project>
Oct 26 07:06:34 user nova-compute[74295]:       </nova:owner>
Oct 26 07:06:34 user nova-compute[74295]:       <nova:root type="image" uuid="f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120"/>
Oct 26 07:06:34 user nova-compute[74295]:       <nova:ports>
Oct 26 07:06:34 user nova-compute[74295]:         <nova:port uuid="e9abfb83-34a9-4c1b-b4f9-5157c83ffaea">
Oct 26 07:06:34 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 07:06:34 user nova-compute[74295]:         </nova:port>
Oct 26 07:06:34 user nova-compute[74295]:       </nova:ports>
Oct 26 07:06:34 user nova-compute[74295]:     </nova:instance>
Oct 26 07:06:34 user nova-compute[74295]:   </metadata>
Oct 26 07:06:34 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 07:06:34 user nova-compute[74295]:     <system>
Oct 26 07:06:34 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 07:06:34 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 07:06:34 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 07:06:34 user nova-compute[74295]:       <entry name="serial">02f7cdb7-5370-4a42-99df-d288b10abb5e</entry>
Oct 26 07:06:34 user nova-compute[74295]:       <entry name="uuid">02f7cdb7-5370-4a42-99df-d288b10abb5e</entry>
Oct 26 07:06:34 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 07:06:34 user nova-compute[74295]:     </system>
Oct 26 07:06:34 user nova-compute[74295]:   </sysinfo>
Oct 26 07:06:34 user nova-compute[74295]:   <os>
Oct 26 07:06:34 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 07:06:34 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 07:06:34 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 07:06:34 user nova-compute[74295]:   </os>
Oct 26 07:06:34 user nova-compute[74295]:   <features>
Oct 26 07:06:34 user nova-compute[74295]:     <acpi/>
Oct 26 07:06:34 user nova-compute[74295]:     <apic/>
Oct 26 07:06:34 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 07:06:34 user nova-compute[74295]:   </features>
Oct 26 07:06:34 user nova-compute[74295]:   <clock offset="utc">
Oct 26 07:06:34 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 07:06:34 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 07:06:34 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 07:06:34 user nova-compute[74295]:   </clock>
Oct 26 07:06:34 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 07:06:34 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 07:06:34 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 07:06:34 user nova-compute[74295]:   </cpu>
Oct 26 07:06:34 user nova-compute[74295]:   <devices>
Oct 26 07:06:34 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 07:06:34 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 07:06:34 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk"/>
Oct 26 07:06:34 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 07:06:34 user nova-compute[74295]:     </disk>
Oct 26 07:06:34 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 07:06:34 user nova-compute[74295]:       <mac address="fa:16:3e:f8:4a:73"/>
Oct 26 07:06:34 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:06:34 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 07:06:34 user nova-compute[74295]:       <target dev="tape9abfb83-34"/>
Oct 26 07:06:34 user nova-compute[74295]:     </interface>
Oct 26 07:06:34 user nova-compute[74295]:     <serial type="pty">
Oct 26 07:06:34 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/console.log" append="off"/>
Oct 26 07:06:34 user nova-compute[74295]:     </serial>
Oct 26 07:06:34 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 07:06:34 user nova-compute[74295]:     <video>
Oct 26 07:06:34 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:06:34 user nova-compute[74295]:     </video>
Oct 26 07:06:34 user nova-compute[74295]:     <rng model="virtio">
Oct 26 07:06:34 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 07:06:34 user nova-compute[74295]:     </rng>
Oct 26 07:06:34 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 07:06:34 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 07:06:34 user nova-compute[74295]:       <stats period="10"/>
Oct 26 07:06:34 user nova-compute[74295]:     </memballoon>
Oct 26 07:06:34 user nova-compute[74295]:   </devices>
Oct 26 07:06:34 user nova-compute[74295]: </domain>
Oct 26 07:06:34 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-781733888',display_name='tempest-VolumesActionsTest-instance-781733888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-781733888',id=51,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1ea4a83d7704370bb3da9e360d917a5',ramdisk_id='',reservation_id='r-8pox164z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-94660942',owner_user_name='tempest-VolumesActionsTest-94660942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T07:06:33Z,user_data=None,user_id='d84c0ab900e943f69d81d9363f1459e4',uuid=02f7cdb7-5370-4a42-99df-d288b10abb5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converting VIF {"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:73,bridge_name='br-int',has_traffic_filtering=True,id=e9abfb83-34a9-4c1b-b4f9-5157c83ffaea,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9abfb83-34') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG os_vif [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:73,bridge_name='br-int',has_traffic_filtering=True,id=e9abfb83-34a9-4c1b-b4f9-5157c83ffaea,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9abfb83-34') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0880a25-170e-50ef-8306-53e8e6b10b4d', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9abfb83-34, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9abfb83-34, col_values=(('qos', UUID('f3c5b44c-5d87-47d6-afcc-b4b48b39f967')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9abfb83-34, col_values=(('external_ids', {'iface-id': 'e9abfb83-34a9-4c1b-b4f9-5157c83ffaea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:4a:73', 'vm-uuid': '02f7cdb7-5370-4a42-99df-d288b10abb5e'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:34 user nova-compute[74295]: INFO os_vif [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4a:73,bridge_name='br-int',has_traffic_filtering=True,id=e9abfb83-34a9-4c1b-b4f9-5157c83ffaea,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9abfb83-34')
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] No VIF found with MAC fa:16:3e:f8:4a:73, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-d83d1a8b-9165-4e10-928a-9ff99e0212da req-6cdbb7a4-3981-4ca9-a188-3b4019b9e562 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Updated VIF entry in instance network info cache for port e9abfb83-34a9-4c1b-b4f9-5157c83ffaea. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-d83d1a8b-9165-4e10-928a-9ff99e0212da req-6cdbb7a4-3981-4ca9-a188-3b4019b9e562 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Updating instance_info_cache with network_info: [{"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:06:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d83d1a8b-9165-4e10-928a-9ff99e0212da req-6cdbb7a4-3981-4ca9-a188-3b4019b9e562 service nova] Releasing lock "refresh_cache-02f7cdb7-5370-4a42-99df-d288b10abb5e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:06:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a8c97875-097c-40ae-a2a2-759274b89c56 req-b1cb34c8-ab2b-49e1-b0a6-f5cdd7aede02 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received event network-vif-plugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:06:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a8c97875-097c-40ae-a2a2-759274b89c56 req-b1cb34c8-ab2b-49e1-b0a6-f5cdd7aede02 service nova] Acquiring lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a8c97875-097c-40ae-a2a2-759274b89c56 req-b1cb34c8-ab2b-49e1-b0a6-f5cdd7aede02 service nova] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-a8c97875-097c-40ae-a2a2-759274b89c56 req-b1cb34c8-ab2b-49e1-b0a6-f5cdd7aede02 service nova] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-a8c97875-097c-40ae-a2a2-759274b89c56 req-b1cb34c8-ab2b-49e1-b0a6-f5cdd7aede02 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] No waiting events found dispatching network-vif-plugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:06:36 user nova-compute[74295]: WARNING nova.compute.manager [req-a8c97875-097c-40ae-a2a2-759274b89c56 req-b1cb34c8-ab2b-49e1-b0a6-f5cdd7aede02 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received unexpected event network-vif-plugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea for instance with vm_state building and task_state spawning.
Oct 26 07:06:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:37 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 07:06:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 07:06:37 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Instance spawned successfully.
Oct 26 07:06:37 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:06:38 user nova-compute[74295]: INFO nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Took 5.43 seconds to spawn the instance on the hypervisor.
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-9817936e-852e-4743-ac38-2f0ceec8246a req-e39c78a2-cd7b-4c2d-b464-4ccbc888452a service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received event network-vif-plugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9817936e-852e-4743-ac38-2f0ceec8246a req-e39c78a2-cd7b-4c2d-b464-4ccbc888452a service nova] Acquiring lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9817936e-852e-4743-ac38-2f0ceec8246a req-e39c78a2-cd7b-4c2d-b464-4ccbc888452a service nova] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-9817936e-852e-4743-ac38-2f0ceec8246a req-e39c78a2-cd7b-4c2d-b464-4ccbc888452a service nova] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.compute.manager [req-9817936e-852e-4743-ac38-2f0ceec8246a req-e39c78a2-cd7b-4c2d-b464-4ccbc888452a service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] No waiting events found dispatching network-vif-plugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:06:38 user nova-compute[74295]: WARNING nova.compute.manager [req-9817936e-852e-4743-ac38-2f0ceec8246a req-e39c78a2-cd7b-4c2d-b464-4ccbc888452a service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received unexpected event network-vif-plugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea for instance with vm_state building and task_state spawning.
Oct 26 07:06:38 user nova-compute[74295]: INFO nova.compute.manager [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Took 6.00 seconds to build instance.
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-9640e28d-42a9-4f32-8a5f-bb6acab67fdf tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.094s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:38 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:39 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:06:39 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:06:39 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.02007293701172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 69fc86e9-940c-4908-bf93-1d5453012c5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 02f7cdb7-5370-4a42-99df-d288b10abb5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:06:39 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:06:40 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:06:40 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:06:40 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:06:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:41 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69fc86e9-940c-4908-bf93-1d5453012c5c is timed out.
Oct 26 07:06:41 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully detached device vdb from instance 69fc86e9-940c-4908-bf93-1d5453012c5c from the live domain config.
Oct 26 07:06:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECqOuvNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 07:06:41 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a4e08b-9b0f-4d95-aa04-1997616a3483]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 07:06:41 user nova-compute[74295]: No targets found.
Oct 26 07:06:41 user nova-compute[74295]: iSNS:
Oct 26 07:06:41 user nova-compute[74295]: No targets found.
Oct 26 07:06:41 user nova-compute[74295]: STATIC:
Oct 26 07:06:41 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2
Oct 26 07:06:41 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 07:06:41 user nova-compute[74295]:                 Iface Name: default
Oct 26 07:06:41 user nova-compute[74295]: FIRMWARE:
Oct 26 07:06:41 user nova-compute[74295]: No targets found.
Oct 26 07:06:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 07:06:41 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 07:06:41 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b5cf8-e87c-4a08-9213-857c0023dd47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3a66df-272f-411d-b4b4-668194aa2ebd]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)
Oct 26 07:06:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 (non-flash)
Oct 26 07:06:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac74b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e142bf-a805-4875-abe7-b04d243da51b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[323932e7-35b3-45b1-92e1-0d2b377f462a]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab25a1a9-8913-4213-9693-fba1912dbdbe]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[179f56c1-f60c-4160-91e0-3018ccb1467f]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c75f2c-d25b-40f6-a7c3-287383d55c16]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef7346f-c3b7-4e05-9843-2c8859ba9d7f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260]
Oct 26 07:06:41 user nova-compute[74295]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2, portal: 172.16.0.220,3260] successful.
Oct 26 07:06:41 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c7f876-af23-4925-9dd6-ecd729d2b6c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2968f1f9-eec4-40d6-bef7-2bb15aa91808]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] <== disconnect_volume: return (319ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 07:06:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 07:06:42 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:06:42 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:06:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:06:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:06:42 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:06:42 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:06:42 user nova-compute[74295]: DEBUG nova.objects.instance [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'flavor' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:06:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-a63bf1d2-2502-49cc-934f-12e46b55e333 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.728s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:06:43 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [{"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:06:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-69fc86e9-940c-4908-bf93-1d5453012c5c" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:06:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:06:43 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:57 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:06:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:06:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:07:21 user nova-compute[74295]: INFO nova.compute.manager [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Terminating instance
Oct 26 07:07:21 user nova-compute[74295]: DEBUG nova.compute.manager [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-39eb38ba-f514-4ea5-9ae4-1f9a166f9599 req-cb8b022d-dbfc-442f-b3a8-2cdb340283b3 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-unplugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-39eb38ba-f514-4ea5-9ae4-1f9a166f9599 req-cb8b022d-dbfc-442f-b3a8-2cdb340283b3 service nova] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-39eb38ba-f514-4ea5-9ae4-1f9a166f9599 req-cb8b022d-dbfc-442f-b3a8-2cdb340283b3 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-39eb38ba-f514-4ea5-9ae4-1f9a166f9599 req-cb8b022d-dbfc-442f-b3a8-2cdb340283b3 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-39eb38ba-f514-4ea5-9ae4-1f9a166f9599 req-cb8b022d-dbfc-442f-b3a8-2cdb340283b3 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] No waiting events found dispatching network-vif-unplugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-39eb38ba-f514-4ea5-9ae4-1f9a166f9599 req-cb8b022d-dbfc-442f-b3a8-2cdb340283b3 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-unplugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 07:07:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:22 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Instance destroyed successfully.
Oct 26 07:07:22 user nova-compute[74295]: DEBUG nova.objects.instance [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'resources' on Instance uuid 69fc86e9-940c-4908-bf93-1d5453012c5c {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:01:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1914782709',display_name='tempest-TestMinimumBasicScenario-server-1914782709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1914782709',id=49,image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaRv8ANlSgUHRv/nDFHs+nItRh5zcQgCRgEh547YsGttZ22djFF9IjemxGCQTDPSDlFbSXA7hynslyggfdgBwK8c/9GXMIVS47JSmUnhO95iu+++L6Z8ZML/rg7rzYPkA==',key_name='tempest-TestMinimumBasicScenario-1113082317',keypairs=<?>,launch_index=0,launched_at=2023-10-26T07:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8ca02ae7f949259a2709a5ffa98852',ramdisk_id='',reservation_id='r-q1ufesh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e930dac7-088b-424c-9354-ebc0f2dcfc7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-230365205',owner_user_name='tempest-TestMinimumBasicScenario-230365205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T07:04:35Z,user_data=None,user_id='f57b2d2a359e42f6916e19d83c33ad99',uuid=69fc86e9-940c-4908-bf93-1d5453012c5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converting VIF {"id": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "address": "fa:16:3e:22:8c:bc", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f8fb4b-a0", "ovs_interfaceid": "93f8fb4b-a09f-4444-8389-3f3efa7dec33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG os_vif [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93f8fb4b-a0, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8b06c1f-8385-4b05-b3e5-d8097cbc763a) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:07:22 user nova-compute[74295]: INFO os_vif [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:8c:bc,bridge_name='br-int',has_traffic_filtering=True,id=93f8fb4b-a09f-4444-8389-3f3efa7dec33,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f8fb4b-a0')
Oct 26 07:07:22 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Deleting instance files /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c_del
Oct 26 07:07:22 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Deletion of /opt/stack/data/nova/instances/69fc86e9-940c-4908-bf93-1d5453012c5c_del complete
Oct 26 07:07:22 user nova-compute[74295]: INFO nova.compute.manager [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 07:07:22 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 07:07:22 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:07:22 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Took 0.65 seconds to deallocate network for instance.
Oct 26 07:07:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-088c981b-2fc7-41ca-a0f0-1a6140017a1c req-a403c400-761a-4b86-8b8e-683a4c16bcbc service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-deleted-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:07:23 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Deleted allocations for instance 69fc86e9-940c-4908-bf93-1d5453012c5c
Oct 26 07:07:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-956831d4-d4cd-45a1-9fc5-eb0dfe0c73cf tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.875s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG nova.compute.manager [req-b30cb0c2-f1b0-4dd4-8ac4-bd1f21b54c1e req-79301e21-0aaa-45a3-b8a8-3a0d3a010987 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b30cb0c2-f1b0-4dd4-8ac4-bd1f21b54c1e req-79301e21-0aaa-45a3-b8a8-3a0d3a010987 service nova] Acquiring lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b30cb0c2-f1b0-4dd4-8ac4-bd1f21b54c1e req-79301e21-0aaa-45a3-b8a8-3a0d3a010987 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-b30cb0c2-f1b0-4dd4-8ac4-bd1f21b54c1e req-79301e21-0aaa-45a3-b8a8-3a0d3a010987 service nova] Lock "69fc86e9-940c-4908-bf93-1d5453012c5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:07:23 user nova-compute[74295]: DEBUG nova.compute.manager [req-b30cb0c2-f1b0-4dd4-8ac4-bd1f21b54c1e req-79301e21-0aaa-45a3-b8a8-3a0d3a010987 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] No waiting events found dispatching network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:07:23 user nova-compute[74295]: WARNING nova.compute.manager [req-b30cb0c2-f1b0-4dd4-8ac4-bd1f21b54c1e req-79301e21-0aaa-45a3-b8a8-3a0d3a010987 service nova] [instance: 69fc86e9-940c-4908-bf93-1d5453012c5c] Received unexpected event network-vif-plugged-93f8fb4b-a09f-4444-8389-3f3efa7dec33 for instance with vm_state deleted and task_state None.
Oct 26 07:07:27 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:07:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:07:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:07:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:07:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:37 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:07:37 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:07:39 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:07:40 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:07:40 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:07:40 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8871MB free_disk=25.01953887939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance 02f7cdb7-5370-4a42-99df-d288b10abb5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 07:07:41 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:42 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:43 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:43 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:43 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:07:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-02f7cdb7-5370-4a42-99df-d288b10abb5e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:07:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-02f7cdb7-5370-4a42-99df-d288b10abb5e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:07:43 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:07:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Updating instance_info_cache with network_info: [{"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:07:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-02f7cdb7-5370-4a42-99df-d288b10abb5e" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:07:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:07:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:47 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:07:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 07:07:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 07:07:48 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:07:52 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:07:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:07:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:07:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:07:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:07:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:07:57 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:07 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:08:12 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Starting instance... {{(pid=74295) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74295) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 07:08:15 user nova-compute[74295]: INFO nova.compute.claims [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Claim successful on node user
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Start building networks asynchronously for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Allocating IP information in the background. {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] allocate_for_instance() {{(pid=74295) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 07:08:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Start building block device mappings for instance. {{(pid=74295) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.policy [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f57b2d2a359e42f6916e19d83c33ad99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8ca02ae7f949259a2709a5ffa98852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74295) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Start spawning the instance on the hypervisor. {{(pid=74295) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Creating instance directory {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 07:08:15 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Creating image(s)
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "/opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "/opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "93493485f4d596885c6a6c66d976cea19e324879" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:15 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "93493485f4d596885c6a6c66d976cea19e324879" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879.part --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Successfully created port: 22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG nova.virt.images [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] 8719e79d-f415-461e-853e-02cacac46a19 was qcow2, converting to raw {{(pid=74295) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG nova.privsep.utils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74295) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879.part /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879.converted {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879.part /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879.converted" returned: 0 in 0.245s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879.converted --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "93493485f4d596885c6a6c66d976cea19e324879" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.057s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:16 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Successfully updated port: 22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-428f838d-846e-47e2-a018-163d0e48b2f1 req-6c225427-4577-4d2b-a9f2-da0a9136e687 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.compute.manager [req-428f838d-846e-47e2-a018-163d0e48b2f1 req-6c225427-4577-4d2b-a9f2-da0a9136e687 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing instance network info cache due to event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-428f838d-846e-47e2-a018-163d0e48b2f1 req-6c225427-4577-4d2b-a9f2-da0a9136e687 service nova] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Instance cache missing network info. {{(pid=74295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879 --force-share --output=json" returned: 0 in 0.168s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "93493485f4d596885c6a6c66d976cea19e324879" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "93493485f4d596885c6a6c66d976cea19e324879" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879 --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879,backing_fmt=raw /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk 1073741824 {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.neutron [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879,backing_fmt=raw /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk 1073741824" returned: 0 in 0.130s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "93493485f4d596885c6a6c66d976cea19e324879" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879 --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Instance network_info: |[{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74295) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-428f838d-846e-47e2-a018-163d0e48b2f1 req-6c225427-4577-4d2b-a9f2-da0a9136e687 service nova] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.neutron [req-428f838d-846e-47e2-a018-163d0e48b2f1 req-6c225427-4577-4d2b-a9f2-da0a9136e687 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93493485f4d596885c6a6c66d976cea19e324879 --force-share --output=json" returned: 0 in 0.188s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk. size=1073741824 {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.disk.api [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Cannot resize image /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk to a smaller size. {{(pid=74295) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Created local disks {{(pid=74295) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Ensure instance console log exists: /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/console.log {{(pid=74295) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Start _get_guest_xml network_info=[{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T07:08:13Z,direct_url=<?>,disk_format='qcow2',id=8719e79d-f415-461e-853e-02cacac46a19,min_disk=0,min_ram=0,name='tempest-scenario-img--445282633',owner='7c8ca02ae7f949259a2709a5ffa98852',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T07:08:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '8719e79d-f415-461e-853e-02cacac46a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 07:08:17 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:08:17 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CPU controller missing on host. {{(pid=74295) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.host [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CPU controller found on host. {{(pid=74295) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74295) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T06:22:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T07:08:13Z,direct_url=<?>,disk_format='qcow2',id=8719e79d-f415-461e-853e-02cacac46a19,min_disk=0,min_ram=0,name='tempest-scenario-img--445282633',owner='7c8ca02ae7f949259a2709a5ffa98852',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T07:08:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Flavor limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Image limits 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Flavor pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Image pref 0:0:0 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Got 1 possible topologies {{(pid=74295) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.hardware [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74295) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2143085706',display_name='tempest-TestMinimumBasicScenario-server-2143085706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2143085706',id=52,image_ref='8719e79d-f415-461e-853e-02cacac46a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVtuc4d58dJsy3qLwPYu3Cv5BGVPgQhI0/ytPH84ZMWiuNeD202/+qJdE0HsWIo+iNBb6+5/WR7KRe9fi5v5x8dLVWTFSJnngFe3tKKnjzl9+n44gRSybhg5cHZgB5Qbg==',key_name='tempest-TestMinimumBasicScenario-595043853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8ca02ae7f949259a2709a5ffa98852',ramdisk_id='',reservation_id='r-r0s1cbe5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8719e79d-f415-461e-853e-02cacac46a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-230365205',owner_user_name='tempest-TestMinimumBasicScenario-230365205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T07:08:16Z,user_data=None,user_id='f57b2d2a359e42f6916e19d83c33ad99',uuid=b4a7c302-f27f-4566-a8f0-d7de5997dfc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74295) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converting VIF {"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:09:2d,bridge_name='br-int',has_traffic_filtering=True,id=22dca202-f951-4d35-ba4b-e1e0e78fdc6b,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22dca202-f9') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.objects.instance [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'pci_devices' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.neutron [req-428f838d-846e-47e2-a018-163d0e48b2f1 req-6c225427-4577-4d2b-a9f2-da0a9136e687 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated VIF entry in instance network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.neutron [req-428f838d-846e-47e2-a018-163d0e48b2f1 req-6c225427-4577-4d2b-a9f2-da0a9136e687 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 07:08:17 user nova-compute[74295]:   <uuid>b4a7c302-f27f-4566-a8f0-d7de5997dfc6</uuid>
Oct 26 07:08:17 user nova-compute[74295]:   <name>instance-00000034</name>
Oct 26 07:08:17 user nova-compute[74295]:   <memory>524288</memory>
Oct 26 07:08:17 user nova-compute[74295]:   <vcpu>1</vcpu>
Oct 26 07:08:17 user nova-compute[74295]:   <metadata>
Oct 26 07:08:17 user nova-compute[74295]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 07:08:17 user nova-compute[74295]:       <nova:package version="0.0.0"/>
Oct 26 07:08:17 user nova-compute[74295]:       <nova:name>tempest-TestMinimumBasicScenario-server-2143085706</nova:name>
Oct 26 07:08:17 user nova-compute[74295]:       <nova:creationTime>2023-10-26 07:08:17</nova:creationTime>
Oct 26 07:08:17 user nova-compute[74295]:       <nova:flavor name="m1.tiny">
Oct 26 07:08:17 user nova-compute[74295]:         <nova:memory>512</nova:memory>
Oct 26 07:08:17 user nova-compute[74295]:         <nova:disk>1</nova:disk>
Oct 26 07:08:17 user nova-compute[74295]:         <nova:swap>0</nova:swap>
Oct 26 07:08:17 user nova-compute[74295]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 07:08:17 user nova-compute[74295]:         <nova:vcpus>1</nova:vcpus>
Oct 26 07:08:17 user nova-compute[74295]:       </nova:flavor>
Oct 26 07:08:17 user nova-compute[74295]:       <nova:owner>
Oct 26 07:08:17 user nova-compute[74295]:         <nova:user uuid="f57b2d2a359e42f6916e19d83c33ad99">tempest-TestMinimumBasicScenario-230365205-project-member</nova:user>
Oct 26 07:08:17 user nova-compute[74295]:         <nova:project uuid="7c8ca02ae7f949259a2709a5ffa98852">tempest-TestMinimumBasicScenario-230365205</nova:project>
Oct 26 07:08:17 user nova-compute[74295]:       </nova:owner>
Oct 26 07:08:17 user nova-compute[74295]:       <nova:root type="image" uuid="8719e79d-f415-461e-853e-02cacac46a19"/>
Oct 26 07:08:17 user nova-compute[74295]:       <nova:ports>
Oct 26 07:08:17 user nova-compute[74295]:         <nova:port uuid="22dca202-f951-4d35-ba4b-e1e0e78fdc6b">
Oct 26 07:08:17 user nova-compute[74295]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 07:08:17 user nova-compute[74295]:         </nova:port>
Oct 26 07:08:17 user nova-compute[74295]:       </nova:ports>
Oct 26 07:08:17 user nova-compute[74295]:     </nova:instance>
Oct 26 07:08:17 user nova-compute[74295]:   </metadata>
Oct 26 07:08:17 user nova-compute[74295]:   <sysinfo type="smbios">
Oct 26 07:08:17 user nova-compute[74295]:     <system>
Oct 26 07:08:17 user nova-compute[74295]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 07:08:17 user nova-compute[74295]:       <entry name="product">OpenStack Nova</entry>
Oct 26 07:08:17 user nova-compute[74295]:       <entry name="version">0.0.0</entry>
Oct 26 07:08:17 user nova-compute[74295]:       <entry name="serial">b4a7c302-f27f-4566-a8f0-d7de5997dfc6</entry>
Oct 26 07:08:17 user nova-compute[74295]:       <entry name="uuid">b4a7c302-f27f-4566-a8f0-d7de5997dfc6</entry>
Oct 26 07:08:17 user nova-compute[74295]:       <entry name="family">Virtual Machine</entry>
Oct 26 07:08:17 user nova-compute[74295]:     </system>
Oct 26 07:08:17 user nova-compute[74295]:   </sysinfo>
Oct 26 07:08:17 user nova-compute[74295]:   <os>
Oct 26 07:08:17 user nova-compute[74295]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 07:08:17 user nova-compute[74295]:     <boot dev="hd"/>
Oct 26 07:08:17 user nova-compute[74295]:     <smbios mode="sysinfo"/>
Oct 26 07:08:17 user nova-compute[74295]:   </os>
Oct 26 07:08:17 user nova-compute[74295]:   <features>
Oct 26 07:08:17 user nova-compute[74295]:     <acpi/>
Oct 26 07:08:17 user nova-compute[74295]:     <apic/>
Oct 26 07:08:17 user nova-compute[74295]:     <vmcoreinfo/>
Oct 26 07:08:17 user nova-compute[74295]:   </features>
Oct 26 07:08:17 user nova-compute[74295]:   <clock offset="utc">
Oct 26 07:08:17 user nova-compute[74295]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 07:08:17 user nova-compute[74295]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 07:08:17 user nova-compute[74295]:     <timer name="hpet" present="no"/>
Oct 26 07:08:17 user nova-compute[74295]:   </clock>
Oct 26 07:08:17 user nova-compute[74295]:   <cpu mode="custom" match="exact">
Oct 26 07:08:17 user nova-compute[74295]:     <model>Nehalem</model>
Oct 26 07:08:17 user nova-compute[74295]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 07:08:17 user nova-compute[74295]:   </cpu>
Oct 26 07:08:17 user nova-compute[74295]:   <devices>
Oct 26 07:08:17 user nova-compute[74295]:     <disk type="file" device="disk">
Oct 26 07:08:17 user nova-compute[74295]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 07:08:17 user nova-compute[74295]:       <source file="/opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk"/>
Oct 26 07:08:17 user nova-compute[74295]:       <target dev="vda" bus="virtio"/>
Oct 26 07:08:17 user nova-compute[74295]:     </disk>
Oct 26 07:08:17 user nova-compute[74295]:     <interface type="ethernet">
Oct 26 07:08:17 user nova-compute[74295]:       <mac address="fa:16:3e:8a:09:2d"/>
Oct 26 07:08:17 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:08:17 user nova-compute[74295]:       <mtu size="1442"/>
Oct 26 07:08:17 user nova-compute[74295]:       <target dev="tap22dca202-f9"/>
Oct 26 07:08:17 user nova-compute[74295]:     </interface>
Oct 26 07:08:17 user nova-compute[74295]:     <serial type="pty">
Oct 26 07:08:17 user nova-compute[74295]:       <log file="/opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/console.log" append="off"/>
Oct 26 07:08:17 user nova-compute[74295]:     </serial>
Oct 26 07:08:17 user nova-compute[74295]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 07:08:17 user nova-compute[74295]:     <video>
Oct 26 07:08:17 user nova-compute[74295]:       <model type="virtio"/>
Oct 26 07:08:17 user nova-compute[74295]:     </video>
Oct 26 07:08:17 user nova-compute[74295]:     <rng model="virtio">
Oct 26 07:08:17 user nova-compute[74295]:       <backend model="random">/dev/urandom</backend>
Oct 26 07:08:17 user nova-compute[74295]:     </rng>
Oct 26 07:08:17 user nova-compute[74295]:     <controller type="usb" index="0" model="none"/>
Oct 26 07:08:17 user nova-compute[74295]:     <memballoon model="virtio">
Oct 26 07:08:17 user nova-compute[74295]:       <stats period="10"/>
Oct 26 07:08:17 user nova-compute[74295]:     </memballoon>
Oct 26 07:08:17 user nova-compute[74295]:   </devices>
Oct 26 07:08:17 user nova-compute[74295]: </domain>
Oct 26 07:08:17 user nova-compute[74295]:  {{(pid=74295) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2143085706',display_name='tempest-TestMinimumBasicScenario-server-2143085706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2143085706',id=52,image_ref='8719e79d-f415-461e-853e-02cacac46a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVtuc4d58dJsy3qLwPYu3Cv5BGVPgQhI0/ytPH84ZMWiuNeD202/+qJdE0HsWIo+iNBb6+5/WR7KRe9fi5v5x8dLVWTFSJnngFe3tKKnjzl9+n44gRSybhg5cHZgB5Qbg==',key_name='tempest-TestMinimumBasicScenario-595043853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8ca02ae7f949259a2709a5ffa98852',ramdisk_id='',reservation_id='r-r0s1cbe5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8719e79d-f415-461e-853e-02cacac46a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-230365205',owner_user_name='tempest-TestMinimumBasicScenario-230365205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T07:08:16Z,user_data=None,user_id='f57b2d2a359e42f6916e19d83c33ad99',uuid=b4a7c302-f27f-4566-a8f0-d7de5997dfc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converting VIF {"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:09:2d,bridge_name='br-int',has_traffic_filtering=True,id=22dca202-f951-4d35-ba4b-e1e0e78fdc6b,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22dca202-f9') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG os_vif [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:09:2d,bridge_name='br-int',has_traffic_filtering=True,id=22dca202-f951-4d35-ba4b-e1e0e78fdc6b,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22dca202-f9') {{(pid=74295) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e6ac1eb-0500-5477-8a46-bb6e09e12db6', '_type': 'linux-noop'}}, row=False) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-428f838d-846e-47e2-a018-163d0e48b2f1 req-6c225427-4577-4d2b-a9f2-da0a9136e687 service nova] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22dca202-f9, may_exist=True, interface_attrs={}) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22dca202-f9, col_values=(('qos', UUID('0fb08e72-859e-4466-b100-95aa3683a47d')),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22dca202-f9, col_values=(('external_ids', {'iface-id': '22dca202-f951-4d35-ba4b-e1e0e78fdc6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:09:2d', 'vm-uuid': 'b4a7c302-f27f-4566-a8f0-d7de5997dfc6'}),), if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:17 user nova-compute[74295]: INFO os_vif [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:09:2d,bridge_name='br-int',has_traffic_filtering=True,id=22dca202-f951-4d35-ba4b-e1e0e78fdc6b,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22dca202-f9')
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 07:08:17 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No VIF found with MAC fa:16:3e:8a:09:2d, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 07:08:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-951e2eeb-e19d-4025-aaf8-b339e4e176db req-91eff289-34b0-45fc-b5a8-10efd3f70c31 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:08:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-951e2eeb-e19d-4025-aaf8-b339e4e176db req-91eff289-34b0-45fc-b5a8-10efd3f70c31 service nova] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-951e2eeb-e19d-4025-aaf8-b339e4e176db req-91eff289-34b0-45fc-b5a8-10efd3f70c31 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:19 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-951e2eeb-e19d-4025-aaf8-b339e4e176db req-91eff289-34b0-45fc-b5a8-10efd3f70c31 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:19 user nova-compute[74295]: DEBUG nova.compute.manager [req-951e2eeb-e19d-4025-aaf8-b339e4e176db req-91eff289-34b0-45fc-b5a8-10efd3f70c31 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] No waiting events found dispatching network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:08:19 user nova-compute[74295]: WARNING nova.compute.manager [req-951e2eeb-e19d-4025-aaf8-b339e4e176db req-91eff289-34b0-45fc-b5a8-10efd3f70c31 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received unexpected event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b for instance with vm_state building and task_state spawning.
Oct 26 07:08:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Instance event wait completed in 0 seconds for  {{(pid=74295) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Guest created on hypervisor {{(pid=74295) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 07:08:21 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Instance spawned successfully.
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Found default for hw_cdrom_bus of ide {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Found default for hw_disk_bus of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Found default for hw_input_bus of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Found default for hw_pointer_model of None {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Found default for hw_video_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Found default for hw_vif_model of virtio {{(pid=74295) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 07:08:21 user nova-compute[74295]: INFO nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Took 5.47 seconds to spawn the instance on the hypervisor.
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-4c14e297-4a76-4799-a3e7-58058f0154dc req-9041572c-0f18-4794-a2c9-ebd4793400f9 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4c14e297-4a76-4799-a3e7-58058f0154dc req-9041572c-0f18-4794-a2c9-ebd4793400f9 service nova] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4c14e297-4a76-4799-a3e7-58058f0154dc req-9041572c-0f18-4794-a2c9-ebd4793400f9 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-4c14e297-4a76-4799-a3e7-58058f0154dc req-9041572c-0f18-4794-a2c9-ebd4793400f9 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:21 user nova-compute[74295]: DEBUG nova.compute.manager [req-4c14e297-4a76-4799-a3e7-58058f0154dc req-9041572c-0f18-4794-a2c9-ebd4793400f9 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] No waiting events found dispatching network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:08:21 user nova-compute[74295]: WARNING nova.compute.manager [req-4c14e297-4a76-4799-a3e7-58058f0154dc req-9041572c-0f18-4794-a2c9-ebd4793400f9 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received unexpected event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b for instance with vm_state building and task_state spawning.
Oct 26 07:08:21 user nova-compute[74295]: INFO nova.compute.manager [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Took 6.04 seconds to build instance.
Oct 26 07:08:21 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-2ff4bcbb-d635-42ff-ac79-e9db8e15298c tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.137s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "02f7cdb7-5370-4a42-99df-d288b10abb5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:22 user nova-compute[74295]: INFO nova.compute.manager [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Terminating instance
Oct 26 07:08:22 user nova-compute[74295]: DEBUG nova.compute.manager [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-8e3f90f5-29f1-4b15-a937-896709eaf4c9 req-0775ff2b-df6c-4dab-ae3f-be335edb9273 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received event network-vif-unplugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8e3f90f5-29f1-4b15-a937-896709eaf4c9 req-0775ff2b-df6c-4dab-ae3f-be335edb9273 service nova] Acquiring lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8e3f90f5-29f1-4b15-a937-896709eaf4c9 req-0775ff2b-df6c-4dab-ae3f-be335edb9273 service nova] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8e3f90f5-29f1-4b15-a937-896709eaf4c9 req-0775ff2b-df6c-4dab-ae3f-be335edb9273 service nova] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-8e3f90f5-29f1-4b15-a937-896709eaf4c9 req-0775ff2b-df6c-4dab-ae3f-be335edb9273 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] No waiting events found dispatching network-vif-unplugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:08:22 user nova-compute[74295]: DEBUG nova.compute.manager [req-8e3f90f5-29f1-4b15-a937-896709eaf4c9 req-0775ff2b-df6c-4dab-ae3f-be335edb9273 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received event network-vif-unplugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:23 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Instance destroyed successfully.
Oct 26 07:08:23 user nova-compute[74295]: DEBUG nova.objects.instance [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lazy-loading 'resources' on Instance uuid 02f7cdb7-5370-4a42-99df-d288b10abb5e {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-781733888',display_name='tempest-VolumesActionsTest-instance-781733888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-781733888',id=51,image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T07:06:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1ea4a83d7704370bb3da9e360d917a5',ramdisk_id='',reservation_id='r-8pox164z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f51c1ce8-f8e8-4a6b-a5e1-f0d6ec0bd120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-94660942',owner_user_name='tempest-VolumesActionsTest-94660942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T07:06:38Z,user_data=None,user_id='d84c0ab900e943f69d81d9363f1459e4',uuid=02f7cdb7-5370-4a42-99df-d288b10abb5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converting VIF {"id": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "address": "fa:16:3e:f8:4a:73", "network": {"id": "82198cfb-b195-4b60-96a5-5d269d86174e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1373549430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1ea4a83d7704370bb3da9e360d917a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9abfb83-34", "ovs_interfaceid": "e9abfb83-34a9-4c1b-b4f9-5157c83ffaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4a:73,bridge_name='br-int',has_traffic_filtering=True,id=e9abfb83-34a9-4c1b-b4f9-5157c83ffaea,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9abfb83-34') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG os_vif [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4a:73,bridge_name='br-int',has_traffic_filtering=True,id=e9abfb83-34a9-4c1b-b4f9-5157c83ffaea,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9abfb83-34') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9abfb83-34, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3c5b44c-5d87-47d6-afcc-b4b48b39f967) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:08:23 user nova-compute[74295]: INFO os_vif [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:4a:73,bridge_name='br-int',has_traffic_filtering=True,id=e9abfb83-34a9-4c1b-b4f9-5157c83ffaea,network=Network(82198cfb-b195-4b60-96a5-5d269d86174e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9abfb83-34')
Oct 26 07:08:23 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Deleting instance files /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e_del
Oct 26 07:08:23 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Deletion of /opt/stack/data/nova/instances/02f7cdb7-5370-4a42-99df-d288b10abb5e_del complete
Oct 26 07:08:23 user nova-compute[74295]: INFO nova.compute.manager [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 07:08:23 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 07:08:23 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:08:24 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Took 0.46 seconds to deallocate network for instance.
Oct 26 07:08:24 user nova-compute[74295]: DEBUG nova.compute.manager [req-d18882c1-4039-462a-bddd-5414215d518d req-0a220414-66d0-40f0-ab6e-3a855f9e5d26 service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received event network-vif-deleted-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:08:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:24 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:08:24 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:08:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:24 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Deleted allocations for instance 02f7cdb7-5370-4a42-99df-d288b10abb5e
Oct 26 07:08:24 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-4c33c135-00f3-4125-bd63-c40a191fbf9e tempest-VolumesActionsTest-94660942 tempest-VolumesActionsTest-94660942-project-member] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-49f1e4c0-ba7d-482a-842f-39a55bf78f21 req-f973c187-e46d-41f3-95b1-723b5c89ecec service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received event network-vif-plugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:08:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-49f1e4c0-ba7d-482a-842f-39a55bf78f21 req-f973c187-e46d-41f3-95b1-723b5c89ecec service nova] Acquiring lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-49f1e4c0-ba7d-482a-842f-39a55bf78f21 req-f973c187-e46d-41f3-95b1-723b5c89ecec service nova] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:25 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-49f1e4c0-ba7d-482a-842f-39a55bf78f21 req-f973c187-e46d-41f3-95b1-723b5c89ecec service nova] Lock "02f7cdb7-5370-4a42-99df-d288b10abb5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:25 user nova-compute[74295]: DEBUG nova.compute.manager [req-49f1e4c0-ba7d-482a-842f-39a55bf78f21 req-f973c187-e46d-41f3-95b1-723b5c89ecec service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] No waiting events found dispatching network-vif-plugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:08:25 user nova-compute[74295]: WARNING nova.compute.manager [req-49f1e4c0-ba7d-482a-842f-39a55bf78f21 req-f973c187-e46d-41f3-95b1-723b5c89ecec service nova] [instance: 02f7cdb7-5370-4a42-99df-d288b10abb5e] Received unexpected event network-vif-plugged-e9abfb83-34a9-4c1b-b4f9-5157c83ffaea for instance with vm_state deleted and task_state None.
Oct 26 07:08:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:08:33 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:08:37 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:08:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:08:41 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:08:41 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=24.99065399169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:08:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:08:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:08:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:08:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:08:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:08:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:08:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:08:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:08:44 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:08:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:08:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:08:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:08:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:08:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:08:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:08:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:08:58 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:09:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:09:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:09:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:09:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:09:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:35 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:09:40 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:09:41 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:09:41 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:09:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8889MB free_disk=24.50204849243164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:09:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:09:42 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:43 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:09:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:09:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:09:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:09:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:09:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:09:44 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:09:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:09:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:09:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:09:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:48 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:09:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:09:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:09:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:09:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:09:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:09:58 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:10:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:02 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'flavor' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:10:12 user nova-compute[74295]: INFO nova.compute.manager [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Attaching volume 8f34ee28-fc9c-4561-b97e-097c67c449d6 to /dev/vdb
Oct 26 07:10:12 user nova-compute[74295]: DEBUG os_brick.utils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8886993-68c5-4d9c-82c3-64e44a211f15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1d21ff64fe1\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b95a434-2ddc-4adf-b3cf-6a2503fcddf1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ec9051-b66b-48eb-87a1-4e39ebaf5a10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27334cb-4e55-457c-9d96-331d6feab0b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:12 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Running cmd (subprocess): nvme version {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] nvme not present on system {{(pid=74295) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 07:10:13 user nova-compute[74295]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 07:10:13 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a833f3-03e4-4ace-bb54-7da0716a6120]: (4, '') {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74295) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.lightos [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] LIGHTOS: no hostnqn found. {{(pid=74295) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG os_brick.utils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1d21ff64fe1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG nova.virt.block_device [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating existing volume attachment record: bc871234-5cc1-4120-8cc9-e3ae835da8f0 {{(pid=74295) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 07:10:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:18 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:23 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:10:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Calling os-brick to attach iSCSI Volume {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUuADvBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 07:10:29 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 07:10:29 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 07:10:29 user nova-compute[74295]: INFO os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43e0a0-4026-46fe-bd4d-629bce183565]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 07:10:29 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af9785e-a813-4625-b5bb-8671258dc865]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6] added\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6] added
Oct 26 07:10:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[83046273-5460-4522-a1a7-9d2d54d62d2f]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b2e55a-ef33-4f86-9bf4-c640a3a29ba9]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUuADvBT {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUuADvBT" returned: 0 in 0.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ecadc9-a3f3-490b-948d-20821e99c9ad]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GUuADvBT'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc44ea14-cc02-45db-9241-3bdeedabbcd0]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a85256e-fb67-4635-b914-b87ed2463285]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 07:10:29 user nova-compute[74295]:  {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 07:10:29 user nova-compute[74295]:  {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 07:10:29 user nova-compute[74295]: WARNING os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 07:10:29 user nova-compute[74295]: 
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --login {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf3d625-addb-4e77-b6e2-8ed59783b6d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6, portal: 172.16.0.220,3260]
Oct 26 07:10:29 user nova-compute[74295]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6, portal: 172.16.0.220,3260] successful.
Oct 26 07:10:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c1231d-f4fd-40c2-aa98-48da09b7e436]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b44b97-5015-4c13-b34c-40e8ae9332d4]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 (non-flash)
Oct 26 07:10:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 (non-flash)
Oct 26 07:10:29 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Connected to 172.16.0.220:3260 {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74295) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74295) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b03187-9ca6-49b5-a765-ebe4f90df977]: (4, ('- - 0', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:10:29 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 07:10:30 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74295) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 07:10:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUuADvBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74295) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 07:10:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 07:10:30 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23330373561663061', 'path': '/dev/sdb'} {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 07:10:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330373561663061', 'path': '/dev/sdb'} {{(pid=74295) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 07:10:30 user nova-compute[74295]: DEBUG nova.objects.instance [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'flavor' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:10:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 07:10:30 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 07:10:30 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 07:10:30 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 07:10:30 user nova-compute[74295]:   <serial>8f34ee28-fc9c-4561-b97e-097c67c449d6</serial>
Oct 26 07:10:30 user nova-compute[74295]: </disk>
Oct 26 07:10:30 user nova-compute[74295]:  {{(pid=74295) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 07:10:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 07:10:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74295) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 07:10:31 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] No VIF found with MAC fa:16:3e:8a:09:2d, not building metadata {{(pid=74295) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 07:10:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-b5590d19-e278-4c8f-b822-2203b9725015 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.723s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:10:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-c4207cbf-ee9d-4f90-b11e-bcc8f41b41c4 req-7cfb3cbc-2868-473f-8a17-5d831ecbc211 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:10:34 user nova-compute[74295]: DEBUG nova.compute.manager [req-c4207cbf-ee9d-4f90-b11e-bcc8f41b41c4 req-7cfb3cbc-2868-473f-8a17-5d831ecbc211 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing instance network info cache due to event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:10:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c4207cbf-ee9d-4f90-b11e-bcc8f41b41c4 req-7cfb3cbc-2868-473f-8a17-5d831ecbc211 service nova] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:10:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c4207cbf-ee9d-4f90-b11e-bcc8f41b41c4 req-7cfb3cbc-2868-473f-8a17-5d831ecbc211 service nova] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:10:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-c4207cbf-ee9d-4f90-b11e-bcc8f41b41c4 req-7cfb3cbc-2868-473f-8a17-5d831ecbc211 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:10:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-c4207cbf-ee9d-4f90-b11e-bcc8f41b41c4 req-7cfb3cbc-2868-473f-8a17-5d831ecbc211 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated VIF entry in instance network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:10:34 user nova-compute[74295]: DEBUG nova.network.neutron [req-c4207cbf-ee9d-4f90-b11e-bcc8f41b41c4 req-7cfb3cbc-2868-473f-8a17-5d831ecbc211 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:10:34 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c4207cbf-ee9d-4f90-b11e-bcc8f41b41c4 req-7cfb3cbc-2868-473f-8a17-5d831ecbc211 service nova] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:10:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-d85c323f-fcf3-4eec-9fca-7c7820b9cb22 req-f5dd9b87-4da6-427c-9b6c-d5e64565270f service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:10:36 user nova-compute[74295]: DEBUG nova.compute.manager [req-d85c323f-fcf3-4eec-9fca-7c7820b9cb22 req-f5dd9b87-4da6-427c-9b6c-d5e64565270f service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing instance network info cache due to event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:10:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d85c323f-fcf3-4eec-9fca-7c7820b9cb22 req-f5dd9b87-4da6-427c-9b6c-d5e64565270f service nova] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:10:36 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d85c323f-fcf3-4eec-9fca-7c7820b9cb22 req-f5dd9b87-4da6-427c-9b6c-d5e64565270f service nova] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:10:36 user nova-compute[74295]: DEBUG nova.network.neutron [req-d85c323f-fcf3-4eec-9fca-7c7820b9cb22 req-f5dd9b87-4da6-427c-9b6c-d5e64565270f service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:10:37 user nova-compute[74295]: DEBUG nova.network.neutron [req-d85c323f-fcf3-4eec-9fca-7c7820b9cb22 req-f5dd9b87-4da6-427c-9b6c-d5e64565270f service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated VIF entry in instance network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:10:37 user nova-compute[74295]: DEBUG nova.network.neutron [req-d85c323f-fcf3-4eec-9fca-7c7820b9cb22 req-f5dd9b87-4da6-427c-9b6c-d5e64565270f service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:10:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d85c323f-fcf3-4eec-9fca-7c7820b9cb22 req-f5dd9b87-4da6-427c-9b6c-d5e64565270f service nova] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:10:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:10:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:10:37 user nova-compute[74295]: INFO nova.compute.manager [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Rebooting instance
Oct 26 07:10:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:10:37 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:10:37 user nova-compute[74295]: DEBUG nova.network.neutron [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Building network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 07:10:38 user nova-compute[74295]: DEBUG nova.network.neutron [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:10:38 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:10:38 user nova-compute[74295]: DEBUG nova.compute.manager [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 07:10:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:38 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-8c448e13-ba07-4f47-98d1-5a9dd70121e0 req-38cd4e78-bb6b-4259-9b17-9132edda9e64 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-unplugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8c448e13-ba07-4f47-98d1-5a9dd70121e0 req-38cd4e78-bb6b-4259-9b17-9132edda9e64 service nova] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8c448e13-ba07-4f47-98d1-5a9dd70121e0 req-38cd4e78-bb6b-4259-9b17-9132edda9e64 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8c448e13-ba07-4f47-98d1-5a9dd70121e0 req-38cd4e78-bb6b-4259-9b17-9132edda9e64 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-8c448e13-ba07-4f47-98d1-5a9dd70121e0 req-38cd4e78-bb6b-4259-9b17-9132edda9e64 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] No waiting events found dispatching network-vif-unplugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:10:40 user nova-compute[74295]: WARNING nova.compute.manager [req-8c448e13-ba07-4f47-98d1-5a9dd70121e0 req-38cd4e78-bb6b-4259-9b17-9132edda9e64 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received unexpected event network-vif-unplugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b for instance with vm_state active and task_state reboot_started.
Oct 26 07:10:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:10:40 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:10:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:41 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Instance shutdown successfully.
Oct 26 07:10:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:10:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:10:41 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] No waiting events found dispatching network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:10:44 user nova-compute[74295]: WARNING nova.compute.manager [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received unexpected event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b for instance with vm_state active and task_state reboot_started.
Oct 26 07:10:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] No waiting events found dispatching network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:10:44 user nova-compute[74295]: WARNING nova.compute.manager [req-52892c46-6d97-4ae4-9dfe-bc6cc5232e7f req-d6c9c0cf-a361-4566-93f7-dce10d7bb6e1 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received unexpected event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b for instance with vm_state active and task_state reboot_started.
Oct 26 07:10:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-8793928e-794f-4529-a956-9f48dfa1056d req-220a9122-68ce-4349-bf1b-f47c38b6ebe6 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8793928e-794f-4529-a956-9f48dfa1056d req-220a9122-68ce-4349-bf1b-f47c38b6ebe6 service nova] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8793928e-794f-4529-a956-9f48dfa1056d req-220a9122-68ce-4349-bf1b-f47c38b6ebe6 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-8793928e-794f-4529-a956-9f48dfa1056d req-220a9122-68ce-4349-bf1b-f47c38b6ebe6 service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG nova.compute.manager [req-8793928e-794f-4529-a956-9f48dfa1056d req-220a9122-68ce-4349-bf1b-f47c38b6ebe6 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] No waiting events found dispatching network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:10:44 user nova-compute[74295]: WARNING nova.compute.manager [req-8793928e-794f-4529-a956-9f48dfa1056d req-220a9122-68ce-4349-bf1b-f47c38b6ebe6 service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received unexpected event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b for instance with vm_state active and task_state reboot_started.
Oct 26 07:10:44 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:10:44 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:10:44 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=9089MB free_disk=24.986209869384766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:10:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:10:44 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Instance running successfully.
Oct 26 07:10:44 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Instance soft rebooted successfully.
Oct 26 07:10:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Checking state {{(pid=74295) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 07:10:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-998d4de7-9eb7-42dc-bae6-5e1569ff320a tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.871s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:10:45 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:10:45 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:10:45 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:10:45 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:10:45 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:10:45 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:10:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:10:48 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:48 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:53 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:10:58 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:10:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:03 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:08 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:24 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:34 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:11:36 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:11:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:41 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:11:41 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:11:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:11:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:11:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:11:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:11:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:11:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:11:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74295) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 07:11:42 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:11:42 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:11:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8942MB free_disk=24.984905242919922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:11:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:11:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:11:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:11:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:11:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:11:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:11:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:11:44 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:11:44 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:11:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:11:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:11:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:11:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:11:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:11:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:11:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:11:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:11:48 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:11:49 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:54 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:11:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:11:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:11:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:11:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:11:59 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:04 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:09 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:12:14 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:12:19 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:12:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:28 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:29 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:29 user nova-compute[74295]: DEBUG nova.compute.manager [req-877802a1-5bb4-406f-bf96-436a8ef89a35 req-a8521c61-1b75-43f0-876c-1ef6067748cb service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:12:29 user nova-compute[74295]: DEBUG nova.compute.manager [req-877802a1-5bb4-406f-bf96-436a8ef89a35 req-a8521c61-1b75-43f0-876c-1ef6067748cb service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing instance network info cache due to event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:12:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-877802a1-5bb4-406f-bf96-436a8ef89a35 req-a8521c61-1b75-43f0-876c-1ef6067748cb service nova] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:12:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-877802a1-5bb4-406f-bf96-436a8ef89a35 req-a8521c61-1b75-43f0-876c-1ef6067748cb service nova] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:12:29 user nova-compute[74295]: DEBUG nova.network.neutron [req-877802a1-5bb4-406f-bf96-436a8ef89a35 req-a8521c61-1b75-43f0-876c-1ef6067748cb service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:12:29 user nova-compute[74295]: DEBUG nova.network.neutron [req-877802a1-5bb4-406f-bf96-436a8ef89a35 req-a8521c61-1b75-43f0-876c-1ef6067748cb service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated VIF entry in instance network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:12:29 user nova-compute[74295]: DEBUG nova.network.neutron [req-877802a1-5bb4-406f-bf96-436a8ef89a35 req-a8521c61-1b75-43f0-876c-1ef6067748cb service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:12:29 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-877802a1-5bb4-406f-bf96-436a8ef89a35 req-a8521c61-1b75-43f0-876c-1ef6067748cb service nova] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:12:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:12:30 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:12:30 user nova-compute[74295]: INFO nova.compute.manager [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Detaching volume 8f34ee28-fc9c-4561-b97e-097c67c449d6
Oct 26 07:12:30 user nova-compute[74295]: INFO nova.virt.block_device [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Attempting to driver detach volume 8f34ee28-fc9c-4561-b97e-097c67c449d6 from mountpoint /dev/vdb
Oct 26 07:12:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Attempting to detach device vdb from instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 from the persistent domain config. {{(pid=74295) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 07:12:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 07:12:30 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 07:12:30 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 07:12:30 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 07:12:30 user nova-compute[74295]:   <serial>8f34ee28-fc9c-4561-b97e-097c67c449d6</serial>
Oct 26 07:12:30 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 07:12:30 user nova-compute[74295]: </disk>
Oct 26 07:12:30 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 07:12:30 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully detached device vdb from instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 from the persistent domain config.
Oct 26 07:12:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 from the live domain config. {{(pid=74295) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 07:12:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.guest [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 07:12:30 user nova-compute[74295]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 07:12:30 user nova-compute[74295]:   <source dev="/dev/sdb"/>
Oct 26 07:12:30 user nova-compute[74295]:   <target dev="vdb" bus="virtio"/>
Oct 26 07:12:30 user nova-compute[74295]:   <serial>8f34ee28-fc9c-4561-b97e-097c67c449d6</serial>
Oct 26 07:12:30 user nova-compute[74295]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 07:12:30 user nova-compute[74295]: </disk>
Oct 26 07:12:30 user nova-compute[74295]:  {{(pid=74295) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 07:12:30 user nova-compute[74295]: DEBUG nova.virt.libvirt.driver [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 07:12:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-c5387f4e-c5e9-4930-a52f-011ac3904a76 req-938629ec-fde9-41c1-b8be-1ead17177b3c service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:12:31 user nova-compute[74295]: DEBUG nova.compute.manager [req-c5387f4e-c5e9-4930-a52f-011ac3904a76 req-938629ec-fde9-41c1-b8be-1ead17177b3c service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing instance network info cache due to event network-changed-22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 07:12:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c5387f4e-c5e9-4930-a52f-011ac3904a76 req-938629ec-fde9-41c1-b8be-1ead17177b3c service nova] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:12:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c5387f4e-c5e9-4930-a52f-011ac3904a76 req-938629ec-fde9-41c1-b8be-1ead17177b3c service nova] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:12:31 user nova-compute[74295]: DEBUG nova.network.neutron [req-c5387f4e-c5e9-4930-a52f-011ac3904a76 req-938629ec-fde9-41c1-b8be-1ead17177b3c service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Refreshing network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 07:12:31 user nova-compute[74295]: DEBUG nova.network.neutron [req-c5387f4e-c5e9-4930-a52f-011ac3904a76 req-938629ec-fde9-41c1-b8be-1ead17177b3c service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated VIF entry in instance network info cache for port 22dca202-f951-4d35-ba4b-e1e0e78fdc6b. {{(pid=74295) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 07:12:31 user nova-compute[74295]: DEBUG nova.network.neutron [req-c5387f4e-c5e9-4930-a52f-011ac3904a76 req-938629ec-fde9-41c1-b8be-1ead17177b3c service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:12:31 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-c5387f4e-c5e9-4930-a52f-011ac3904a76 req-938629ec-fde9-41c1-b8be-1ead17177b3c service nova] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:12:33 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:37 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:12:41 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:12:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:12:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:12:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:12:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:41 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:42 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:12:42 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:12:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.984188079833984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74295) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:12:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:12:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:12:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:12:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 07:12:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquired lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 07:12:44 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Forcefully refreshing network info cache for instance {{(pid=74295) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 07:12:44 user nova-compute[74295]: DEBUG nova.objects.instance [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lazy-loading 'info_cache' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG nova.network.neutron [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [{"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Releasing lock "refresh_cache-b4a7c302-f27f-4566-a8f0-d7de5997dfc6" {{(pid=74295) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updated the network info_cache for instance {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 07:12:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:49 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:49 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:50 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 is timed out.
Oct 26 07:12:50 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully detached device vdb from instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6 from the live domain config.
Oct 26 07:12:50 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] calling os-brick to detach iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f35ac502a10>, {'target_iqn': 'iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUuADvBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 07:12:50 user nova-compute[74295]: WARNING os_brick.initiator.connectors.base [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2387ec4b-5ea6-4106-bff6-012541fb8275]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 07:12:50 user nova-compute[74295]: No targets found.
Oct 26 07:12:50 user nova-compute[74295]: iSNS:
Oct 26 07:12:50 user nova-compute[74295]: No targets found.
Oct 26 07:12:50 user nova-compute[74295]: STATIC:
Oct 26 07:12:50 user nova-compute[74295]: Target: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6
Oct 26 07:12:50 user nova-compute[74295]:         Portal: 172.16.0.220:3260,-1
Oct 26 07:12:50 user nova-compute[74295]:                 Iface Name: default
Oct 26 07:12:50 user nova-compute[74295]: FIRMWARE:
Oct 26 07:12:50 user nova-compute[74295]: No targets found.
Oct 26 07:12:50 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 07:12:50 user nova-compute[74295]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 07:12:50 user nova-compute[74295]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74295) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6', 0)] {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b55c95-ecd9-4efb-8051-cf452cc2a5b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f813897-0e99-4e4d-96cb-9d81cfcee291]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 (non-flash)\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 (non-flash)
Oct 26 07:12:50 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 (non-flash)
Oct 26 07:12:50 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f35ac1bc4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6'): ({'sdb'}, set())}) {{(pid=74295) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Removing single pathed devices sdb {{(pid=74295) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3788561b-4c04-4125-a5e6-72583f380d7e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a054a59-1af8-4898-b2fd-5c88de69e80a]: (4, ('ok\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Flushing IO for device /dev/sdb {{(pid=74295) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a488a00-aaa5-4e16-80d3-213cccbe57fe]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74295) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[166e62a5-cf72-475f-8df4-c25a32ebf800]: (4, ('1', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.linuxscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] SCSI volumes sdb have been removed. {{(pid=74295) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6')] {{(pid=74295) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2de21e-4e4c-418e-97fc-442cb4b817d8]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:12:50 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --logout {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5287de4-b7bc-4d96-823b-49d9a6cdde50]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6, portal: 172.16.0.220,3260]
Oct 26 07:12:51 user nova-compute[74295]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6, portal: 172.16.0.220,3260] successful.
Oct 26 07:12:51 user nova-compute[74295]:  stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op delete {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f34ee28-fc9c-4561-b97e-097c67c449d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG oslo.privsep.daemon [-] privsep: reply[52edd346-a6c9-4489-968e-423a1a50b340]: (4, ('', '')) {{(pid=85963) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74295) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.base [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG os_brick.initiator.connectors.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] <== disconnect_volume: return (289ms) None {{(pid=74295) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Disconnected iSCSI Volume {{(pid=74295) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG nova.objects.instance [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'flavor' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:12:51 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-045f360f-3453-4653-b57c-90b30627a14d tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:12:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:12:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:12:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:12:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:12:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:12:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:13:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:13:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:13:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:13:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:13:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:13:00 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 07:13:00 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 07:13:02 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:13:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:39 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:13:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:13:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:13:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:13:39 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:13:39 user nova-compute[74295]: INFO nova.compute.manager [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Terminating instance
Oct 26 07:13:39 user nova-compute[74295]: DEBUG nova.compute.manager [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Start destroying the instance on the hypervisor. {{(pid=74295) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-d393a983-59fe-4666-9acc-10963491112f req-a75da627-7a51-4e27-86c9-1bd8a7665d2e service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-unplugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d393a983-59fe-4666-9acc-10963491112f req-a75da627-7a51-4e27-86c9-1bd8a7665d2e service nova] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d393a983-59fe-4666-9acc-10963491112f req-a75da627-7a51-4e27-86c9-1bd8a7665d2e service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-d393a983-59fe-4666-9acc-10963491112f req-a75da627-7a51-4e27-86c9-1bd8a7665d2e service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-d393a983-59fe-4666-9acc-10963491112f req-a75da627-7a51-4e27-86c9-1bd8a7665d2e service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] No waiting events found dispatching network-vif-unplugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG nova.compute.manager [req-d393a983-59fe-4666-9acc-10963491112f req-a75da627-7a51-4e27-86c9-1bd8a7665d2e service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-unplugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b for instance with task_state deleting. {{(pid=74295) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [-] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Instance destroyed successfully.
Oct 26 07:13:40 user nova-compute[74295]: DEBUG nova.objects.instance [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lazy-loading 'resources' on Instance uuid b4a7c302-f27f-4566-a8f0-d7de5997dfc6 {{(pid=74295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG nova.virt.libvirt.vif [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T07:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2143085706',display_name='tempest-TestMinimumBasicScenario-server-2143085706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2143085706',id=52,image_ref='8719e79d-f415-461e-853e-02cacac46a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVtuc4d58dJsy3qLwPYu3Cv5BGVPgQhI0/ytPH84ZMWiuNeD202/+qJdE0HsWIo+iNBb6+5/WR7KRe9fi5v5x8dLVWTFSJnngFe3tKKnjzl9+n44gRSybhg5cHZgB5Qbg==',key_name='tempest-TestMinimumBasicScenario-595043853',keypairs=<?>,launch_index=0,launched_at=2023-10-26T07:08:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8ca02ae7f949259a2709a5ffa98852',ramdisk_id='',reservation_id='r-r0s1cbe5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8719e79d-f415-461e-853e-02cacac46a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-230365205',owner_user_name='tempest-TestMinimumBasicScenario-230365205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T07:10:45Z,user_data=None,user_id='f57b2d2a359e42f6916e19d83c33ad99',uuid=b4a7c302-f27f-4566-a8f0-d7de5997dfc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converting VIF {"id": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "address": "fa:16:3e:8a:09:2d", "network": {"id": "ee2530dd-beb8-4468-ba2f-7d424479b3ce", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1137370196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8ca02ae7f949259a2709a5ffa98852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22dca202-f9", "ovs_interfaceid": "22dca202-f951-4d35-ba4b-e1e0e78fdc6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG nova.network.os_vif_util [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:09:2d,bridge_name='br-int',has_traffic_filtering=True,id=22dca202-f951-4d35-ba4b-e1e0e78fdc6b,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22dca202-f9') {{(pid=74295) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG os_vif [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:09:2d,bridge_name='br-int',has_traffic_filtering=True,id=22dca202-f951-4d35-ba4b-e1e0e78fdc6b,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22dca202-f9') {{(pid=74295) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22dca202-f9, bridge=br-int, if_exists=True) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fb08e72-859e-4466-b100-95aa3683a47d) {{(pid=74295) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:13:40 user nova-compute[74295]: INFO os_vif [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:09:2d,bridge_name='br-int',has_traffic_filtering=True,id=22dca202-f951-4d35-ba4b-e1e0e78fdc6b,network=Network(ee2530dd-beb8-4468-ba2f-7d424479b3ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22dca202-f9')
Oct 26 07:13:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Deleting instance files /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6_del
Oct 26 07:13:40 user nova-compute[74295]: INFO nova.virt.libvirt.driver [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Deletion of /opt/stack/data/nova/instances/b4a7c302-f27f-4566-a8f0-d7de5997dfc6_del complete
Oct 26 07:13:40 user nova-compute[74295]: INFO nova.compute.manager [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 07:13:40 user nova-compute[74295]: DEBUG oslo.service.loopingcall [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74295) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG nova.compute.manager [-] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Deallocating network for instance {{(pid=74295) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 07:13:40 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] deallocate_for_instance() {{(pid=74295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG nova.network.neutron [-] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Updating instance_info_cache with network_info: [] {{(pid=74295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 07:13:41 user nova-compute[74295]: INFO nova.compute.manager [-] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Took 0.42 seconds to deallocate network for instance.
Oct 26 07:13:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.138s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:13:41 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:13:41 user nova-compute[74295]: INFO nova.scheduler.client.report [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Deleted allocations for instance b4a7c302-f27f-4566-a8f0-d7de5997dfc6
Oct 26 07:13:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-6e3926cd-38da-4a07-978e-2812c9274962 tempest-TestMinimumBasicScenario-230365205 tempest-TestMinimumBasicScenario-230365205-project-member] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.235s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:13:42 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:13:42 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=9089MB free_disk=25.01146697998047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c3ce994-1cfb-4bd6-9010-9fddc2d9b158 req-f1fc1105-d992-4680-876a-9f2ae773807f service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c3ce994-1cfb-4bd6-9010-9fddc2d9b158 req-f1fc1105-d992-4680-876a-9f2ae773807f service nova] Acquiring lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c3ce994-1cfb-4bd6-9010-9fddc2d9b158 req-f1fc1105-d992-4680-876a-9f2ae773807f service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [req-6c3ce994-1cfb-4bd6-9010-9fddc2d9b158 req-f1fc1105-d992-4680-876a-9f2ae773807f service nova] Lock "b4a7c302-f27f-4566-a8f0-d7de5997dfc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c3ce994-1cfb-4bd6-9010-9fddc2d9b158 req-f1fc1105-d992-4680-876a-9f2ae773807f service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] No waiting events found dispatching network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 07:13:42 user nova-compute[74295]: WARNING nova.compute.manager [req-6c3ce994-1cfb-4bd6-9010-9fddc2d9b158 req-f1fc1105-d992-4680-876a-9f2ae773807f service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received unexpected event network-vif-plugged-22dca202-f951-4d35-ba4b-e1e0e78fdc6b for instance with vm_state deleted and task_state None.
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.compute.manager [req-6c3ce994-1cfb-4bd6-9010-9fddc2d9b158 req-f1fc1105-d992-4680-876a-9f2ae773807f service nova] [instance: b4a7c302-f27f-4566-a8f0-d7de5997dfc6] Received event network-vif-deleted-22dca202-f951-4d35-ba4b-e1e0e78fdc6b {{(pid=74295) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:13:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:13:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:13:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:13:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:13:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 07:13:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:48 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:13:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:13:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:13:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:13:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:13:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:13:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:14:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:14:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:14:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:02 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_power_states {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:14:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:14:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:14:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:14:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:14:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:14:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:32 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:40 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:42 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:14:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:14:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:14:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:14:42 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:14:42 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:14:42 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=9119MB free_disk=25.050132751464844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:14:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:14:42 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:14:43 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:14:43 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:14:43 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:14:43 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:14:43 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:14:43 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:14:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:14:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:14:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:14:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 07:14:49 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:14:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:14:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:14:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:14:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:14:51 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:14:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:15:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:03 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:15:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:15:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:42 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:44 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:15:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:15:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:15:44 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:15:44 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:15:45 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:15:45 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:15:45 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=25.048763275146484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:45 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:15:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:15:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 07:15:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:50 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:51 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:15:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:15:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:15:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:15:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:15:55 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:16:00 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:16:05 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:16:10 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:16:13 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:16:15 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:16:20 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:16:25 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:16:30 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:16:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:16:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:16:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:16:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:16:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:16:35 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:16:40 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:16:44 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:16:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:16:45 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:16:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:16:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:16:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:16:45 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:16:45 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:16:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:16:46 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:16:46 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:16:46 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=9117MB free_disk=25.04758071899414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:16:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:16:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:16:46 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:16:46 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:16:46 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:16:46 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:16:46 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:16:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:16:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:16:48 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:16:49 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:16:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:16:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:16:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 07:16:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:16:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:16:51 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:16:52 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:16:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:17:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:17:03 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:17:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:17:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:17:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:17:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:17:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:17:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:17:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:17:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:17:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:17:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:17:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:17:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:17:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:45 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:17:46 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:17:47 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:17:47 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:17:47 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=9087MB free_disk=25.046371459960938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:47 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances with incomplete migration  {{(pid=74295) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 07:17:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:17:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:17:50 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 07:17:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:17:52 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:53 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:17:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:18:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:18:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:04 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Cleaning up deleted instances {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 07:18:04 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] There are 0 instances to clean {{(pid=74295) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 07:18:06 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:18:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:18:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:18:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:11 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:18:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:18:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:16 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:21 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:18:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:18:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:26 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:31 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:18:36 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:18:39 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:41 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:46 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:18:46 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:47 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager.update_available_resource {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:18:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:18:47 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:18:47 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Auditing locally available compute resources for user (node: user) {{(pid=74295) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 07:18:48 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:18:48 user nova-compute[74295]: WARNING nova.virt.libvirt.driver [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Hypervisor/Node resource view: name=user free_ram=9242MB free_disk=25.03588104248047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74295) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74295) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing inventories for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating ProviderTree inventory for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Updating inventory in ProviderTree for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing aggregate associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, aggregates: None {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Refreshing trait associations for resource provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74295) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.compute.provider_tree [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed in ProviderTree for provider: 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 {{(pid=74295) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.scheduler.client.report [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Inventory has not changed for provider 83a4b092-caa9-49fc-b639-9b9bc5d3ce84 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74295) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG nova.compute.resource_tracker [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Compute_service record updated for user:user {{(pid=74295) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 07:18:48 user nova-compute[74295]: DEBUG oslo_concurrency.lockutils [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=74295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 07:18:49 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74295) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 07:18:49 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Starting heal instance info cache {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 07:18:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Rebuilding the list of instances to heal {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 07:18:49 user nova-compute[74295]: DEBUG nova.compute.manager [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Didn't find any instances for network info cache update. {{(pid=74295) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 07:18:50 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 07:18:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74295) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 07:18:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74295) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 07:18:51 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:18:52 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:52 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:54 user nova-compute[74295]: DEBUG oslo_service.periodic_task [None req-1e3322c8-2cb7-46be-8992-75c6a2a660cf None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 07:18:56 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 07:19:01 user nova-compute[74295]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74295) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}